diff options
Diffstat (limited to 'site/docs/0.7.0/api/core/spark')
139 files changed, 77996 insertions, 0 deletions
diff --git a/site/docs/0.7.0/api/core/spark/Accumulable.html b/site/docs/0.7.0/api/core/spark/Accumulable.html new file mode 100644 index 000000000..f48ca5418 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/Accumulable.html @@ -0,0 +1,521 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.Accumulable</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>Accumulable</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">Accumulable</span><span class="tparams">[<span name="R">R</span>, <span name="T">T</span>]</span><span class="result"> extends <span name="java.io.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A datatype that can be accumulated, i.e. has an commutative and associative "add" operation, +but where the result type, <code>R</code>, may be different from the element type being added, <code>T</code>.</p><p>You must define how to add data, and how to merge two of these together. For some datatypes, +such as a counter, these might be the same operation. In that case, you can use the simpler +<a name="spark.Accumulator" class="extype" href="Accumulator.html">Accumulator</a>. They won't always be the same, though -- e.g., imagine you are +accumulating a set. You will add items to the set, and you will union two sets together. +</p></div><dl class="paramcmts block"><dt class="tparam">R</dt><dd class="cmt"><p>the full accumulated data (result type)</p></dd><dt class="tparam">T</dt><dd class="cmt"><p>partial data that can be added in +</p></dd></dl><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div><div class="toggleContainer block"> + <span class="toggle">Known Subclasses</span> + <div class="subClasses hiddenContent"><a name="spark.Accumulator" class="extype" href="Accumulator.html">Accumulator</a></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.Accumulable" class="in"><span>Accumulable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.Accumulable#this" data-isabs="false"> + <a id="this:Accumulable[R, T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">Accumulable</span><span class="params">(<span name="initialValue">initialValue: R</span>, <span name="param">param: <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a>[R, T]</span>)</span> + </span> + </h4> + <p class="shortcomment cmt"></p><div class="fullcomment"><div class="comment cmt"></div><dl class="paramcmts block"><dt class="param">initialValue</dt><dd class="cmt"><p>initial value of accumulator</p></dd><dt class="param">param</dt><dd class="cmt"><p>helper object defining how to add elements of type <code>R</code> and <code>T</code></p></dd></dl></div> + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#++=" data-isabs="false"> + <a id="++=(R):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus$eq">++=</span><span class="params">(<span name="term">term: R</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Merge two accumulable objects together</p><div class="fullcomment"><div class="comment cmt"><p>Merge two accumulable objects together</p><p>Normally, a user will not want to use this version, but will instead call <code>+=</code>.</p></div><dl class="paramcmts block"><dt class="param">term</dt><dd class="cmt"><p>the other <code>R</code> that will get merged with this +</p></dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#+=" data-isabs="false"> + <a id="+=(T):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$eq">+=</span><span class="params">(<span name="term">term: T</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Add more data to this accumulator / accumulable</p><div class="fullcomment"><div class="comment cmt"><p>Add more data to this accumulator / accumulable</p></div><dl class="paramcmts block"><dt class="param">term</dt><dd class="cmt"><p>the data to add +</p></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#add" data-isabs="false"> + <a id="add(T):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">add</span><span class="params">(<span name="term">term: T</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Add more data to this accumulator / accumulable</p><div class="fullcomment"><div class="comment cmt"><p>Add more data to this accumulator / accumulable</p></div><dl class="paramcmts block"><dt class="param">term</dt><dd class="cmt"><p>the data to add +</p></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#deserialized" data-isabs="false"> + <a id="deserialized:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">deserialized</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#id" data-isabs="false"> + <a id="id:Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#localValue" data-isabs="false"> + <a id="localValue:R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">localValue</span><span class="result">: R</span> + </span> + </h4> + <p class="shortcomment cmt">Get the current value of this accumulator from within a task.</p><div class="fullcomment"><div class="comment cmt"><p>Get the current value of this accumulator from within a task.</p><p>This is NOT the global value of the accumulator. To get the global value after a +completed operation on the dataset, call <code>value</code>.</p><p>The typical use of this method is to directly mutate the local value, eg., to add +an element to a Set. +</p></div></div> + </li><li visbl="pub" name="spark.Accumulable#merge" data-isabs="false"> + <a id="merge(R):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">merge</span><span class="params">(<span name="term">term: R</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Merge two accumulable objects together</p><div class="fullcomment"><div class="comment cmt"><p>Merge two accumulable objects together</p><p>Normally, a user will not want to use this version, but will instead call <code>add</code>.</p></div><dl class="paramcmts block"><dt class="param">term</dt><dd class="cmt"><p>the other <code>R</code> that will get merged with this +</p></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#setValue" data-isabs="false"> + <a id="setValue(R):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setValue</span><span class="params">(<span name="newValue">newValue: R</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Set the accumulator's value; only allowed on master +</p> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Accumulable" class="extype" href="">Accumulable</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#value" data-isabs="false"> + <a id="value:R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">value</span><span class="result">: R</span> + </span> + </h4> + <p class="shortcomment cmt">Access the accumulator's current value; only allowed on master.</p> + </li><li visbl="pub" name="spark.Accumulable#value_=" data-isabs="false"> + <a id="value_=(R):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: value_$eq">value_=</span><span class="params">(<span name="newValue">newValue: R</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Set the accumulator's value; only allowed on master.</p> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#zero" data-isabs="false"> + <a id="zero:R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">zero</span><span class="result">: R</span> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/AccumulableParam.html b/site/docs/0.7.0/api/core/spark/AccumulableParam.html new file mode 100644 index 000000000..d193440eb --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/AccumulableParam.html @@ -0,0 +1,410 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.AccumulableParam</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/trait_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>AccumulableParam</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <span class="name">AccumulableParam</span><span class="tparams">[<span name="R">R</span>, <span name="T">T</span>]</span><span class="result"> extends <span name="java.io.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Helper object defining how to accumulate values of a particular type. An implicit +AccumulableParam needs to be available when you create Accumulables of a specific type. +</p></div><dl class="paramcmts block"><dt class="tparam">R</dt><dd class="cmt"><p>the full accumulated data (result type)</p></dd><dt class="tparam">T</dt><dd class="cmt"><p>partial data that can be added in +</p></dd></dl><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div><div class="toggleContainer block"> + <span class="toggle">Known Subclasses</span> + <div class="subClasses hiddenContent"><a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a>, <a name="spark.SparkContext.DoubleAccumulatorParam" class="extype" href="SparkContext$$DoubleAccumulatorParam$.html">DoubleAccumulatorParam</a>, <a name="spark.SparkContext.FloatAccumulatorParam" class="extype" href="SparkContext$$FloatAccumulatorParam$.html">FloatAccumulatorParam</a>, <a name="spark.SparkContext.IntAccumulatorParam" class="extype" href="SparkContext$$IntAccumulatorParam$.html">IntAccumulatorParam</a>, <a name="spark.SparkContext.LongAccumulatorParam" class="extype" href="SparkContext$$LongAccumulatorParam$.html">LongAccumulatorParam</a>, <a name="spark.api.python.PythonAccumulatorParam" class="extype" href="api/python/PythonAccumulatorParam.html">PythonAccumulatorParam</a>, <a name="spark.util.Vector.VectorAccumParam" class="extype" href="util/Vector$$VectorAccumParam$.html">VectorAccumParam</a></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.AccumulableParam" class="in"><span>AccumulableParam</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.AccumulableParam#addAccumulator" data-isabs="true"> + <a id="addAccumulator(R,T):R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addAccumulator</span><span class="params">(<span name="r">r: R</span>, <span name="t">t: T</span>)</span><span class="result">: R</span> + </span> + </h4> + <p class="shortcomment cmt">Add additional data to the accumulator value.</p><div class="fullcomment"><div class="comment cmt"><p>Add additional data to the accumulator value. Is allowed to modify and return <code>r</code> +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt class="param">r</dt><dd class="cmt"><p>the current value of the accumulator</p></dd><dt class="param">t</dt><dd class="cmt"><p>the data to be added to the accumulator</p></dd><dt>returns</dt><dd class="cmt"><p>the new value of the accumulator +</p></dd></dl></div> + </li><li visbl="pub" name="spark.AccumulableParam#addInPlace" data-isabs="true"> + <a id="addInPlace(R,R):R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addInPlace</span><span class="params">(<span name="r1">r1: R</span>, <span name="r2">r2: R</span>)</span><span class="result">: R</span> + </span> + </h4> + <p class="shortcomment cmt">Merge two accumulated values together.</p><div class="fullcomment"><div class="comment cmt"><p>Merge two accumulated values together. Is allowed to modify and return the first value +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt class="param">r1</dt><dd class="cmt"><p>one set of accumulated data</p></dd><dt class="param">r2</dt><dd class="cmt"><p>another set of accumulated data</p></dd><dt>returns</dt><dd class="cmt"><p>both data sets merged together +</p></dd></dl></div> + </li><li visbl="pub" name="spark.AccumulableParam#zero" data-isabs="true"> + <a id="zero(R):R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zero</span><span class="params">(<span name="initialValue">initialValue: R</span>)</span><span class="result">: R</span> + </span> + </h4> + <p class="shortcomment cmt">Return the "zero" (identity) value for an accumulator type, given its initial value.</p><div class="fullcomment"><div class="comment cmt"><p>Return the "zero" (identity) value for an accumulator type, given its initial value. For +example, if R was a vector of N dimensions, this would return a vector of N zeroes. +</p></div></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/Accumulator.html b/site/docs/0.7.0/api/core/spark/Accumulator.html new file mode 100644 index 000000000..9a1221ecc --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/Accumulator.html @@ -0,0 +1,520 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.Accumulator</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>Accumulator</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">Accumulator</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a>[T, T]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A simpler value of <a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a> where the result type being accumulated is the same +as the types of elements being merged. +</p></div><dl class="paramcmts block"><dt class="tparam">T</dt><dd class="cmt"><p>result type +</p></dd></dl><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a>[T, T], <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.Accumulator" class="in"><span>Accumulator</span></li><li name="spark.Accumulable" class="in"><span>Accumulable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.Accumulator#this" data-isabs="false"> + <a id="this:Accumulator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">Accumulator</span><span class="params">(<span name="initialValue">initialValue: T</span>, <span name="param">param: <a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a>[T]</span>)</span> + </span> + </h4> + <p class="shortcomment cmt"></p><div class="fullcomment"><div class="comment cmt"></div><dl class="paramcmts block"><dt class="param">initialValue</dt><dd class="cmt"><p>initial value of accumulator</p></dd><dt class="param">param</dt><dd class="cmt"><p>helper object defining how to add elements of type <code>T</code></p></dd></dl></div> + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#++=" data-isabs="false"> + <a id="++=(T):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus$eq">++=</span><span class="params">(<span name="term">term: T</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Merge two accumulable objects together</p><div class="fullcomment"><div class="comment cmt"><p>Merge two accumulable objects together</p><p>Normally, a user will not want to use this version, but will instead call <code>+=</code>.</p></div><dl class="paramcmts block"><dt class="param">term</dt><dd class="cmt"><p>the other <code>R</code> that will get merged with this +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a></dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#+=" data-isabs="false"> + <a id="+=(T):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$eq">+=</span><span class="params">(<span name="term">term: T</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Add more data to this accumulator / accumulable</p><div class="fullcomment"><div class="comment cmt"><p>Add more data to this accumulator / accumulable</p></div><dl class="paramcmts block"><dt class="param">term</dt><dd class="cmt"><p>the data to add +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#add" data-isabs="false"> + <a id="add(T):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">add</span><span class="params">(<span name="term">term: T</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Add more data to this accumulator / accumulable</p><div class="fullcomment"><div class="comment cmt"><p>Add more data to this accumulator / accumulable</p></div><dl class="paramcmts block"><dt class="param">term</dt><dd class="cmt"><p>the data to add +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#deserialized" data-isabs="false"> + <a id="deserialized:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">deserialized</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#id" data-isabs="false"> + <a id="id:Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#localValue" data-isabs="false"> + <a id="localValue:T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">localValue</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Get the current value of this accumulator from within a task.</p><div class="fullcomment"><div class="comment cmt"><p>Get the current value of this accumulator from within a task.</p><p>This is NOT the global value of the accumulator. To get the global value after a +completed operation on the dataset, call <code>value</code>.</p><p>The typical use of this method is to directly mutate the local value, eg., to add +an element to a Set. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a></dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#merge" data-isabs="false"> + <a id="merge(T):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">merge</span><span class="params">(<span name="term">term: T</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Merge two accumulable objects together</p><div class="fullcomment"><div class="comment cmt"><p>Merge two accumulable objects together</p><p>Normally, a user will not want to use this version, but will instead call <code>add</code>.</p></div><dl class="paramcmts block"><dt class="param">term</dt><dd class="cmt"><p>the other <code>R</code> that will get merged with this +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#setValue" data-isabs="false"> + <a id="setValue(T):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setValue</span><span class="params">(<span name="newValue">newValue: T</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Set the accumulator's value; only allowed on master +</p><div class="fullcomment"><div class="comment cmt"><p>Set the accumulator's value; only allowed on master +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#value" data-isabs="false"> + <a id="value:T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">value</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Access the accumulator's current value; only allowed on master.</p><div class="fullcomment"><div class="comment cmt"><p>Access the accumulator's current value; only allowed on master. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a></dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#value_=" data-isabs="false"> + <a id="value_=(T):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: value_$eq">value_=</span><span class="params">(<span name="newValue">newValue: T</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Set the accumulator's value; only allowed on master.</p><div class="fullcomment"><div class="comment cmt"><p>Set the accumulator's value; only allowed on master. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.Accumulable#zero" data-isabs="false"> + <a id="zero:T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">zero</span><span class="result">: T</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a></dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.Accumulable" class="parent"> + <h3>Inherited from <a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a>[T, T]</h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/AccumulatorParam.html b/site/docs/0.7.0/api/core/spark/AccumulatorParam.html new file mode 100644 index 000000000..1ee03e9dd --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/AccumulatorParam.html @@ -0,0 +1,413 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.AccumulatorParam</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/trait_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>AccumulatorParam</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <span class="name">AccumulatorParam</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a>[T, T]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A simpler version of <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a> where the only datatype you can add in is the same type +as the accumulated value. An implicit AccumulatorParam object needs to be available when you create +Accumulators of a specific type. +</p></div><dl class="paramcmts block"><dt class="tparam">T</dt><dd class="cmt"><p>type of value to accumulate +</p></dd></dl><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a>[T, T], <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div><div class="toggleContainer block"> + <span class="toggle">Known Subclasses</span> + <div class="subClasses hiddenContent"><a name="spark.SparkContext.DoubleAccumulatorParam" class="extype" href="SparkContext$$DoubleAccumulatorParam$.html">DoubleAccumulatorParam</a>, <a name="spark.SparkContext.FloatAccumulatorParam" class="extype" href="SparkContext$$FloatAccumulatorParam$.html">FloatAccumulatorParam</a>, <a name="spark.SparkContext.IntAccumulatorParam" class="extype" href="SparkContext$$IntAccumulatorParam$.html">IntAccumulatorParam</a>, <a name="spark.SparkContext.LongAccumulatorParam" class="extype" href="SparkContext$$LongAccumulatorParam$.html">LongAccumulatorParam</a>, <a name="spark.api.python.PythonAccumulatorParam" class="extype" href="api/python/PythonAccumulatorParam.html">PythonAccumulatorParam</a>, <a name="spark.util.Vector.VectorAccumParam" class="extype" href="util/Vector$$VectorAccumParam$.html">VectorAccumParam</a></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.AccumulatorParam" class="in"><span>AccumulatorParam</span></li><li name="spark.AccumulableParam" class="in"><span>AccumulableParam</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.AccumulableParam#addInPlace" data-isabs="true"> + <a id="addInPlace(T,T):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addInPlace</span><span class="params">(<span name="r1">r1: T</span>, <span name="r2">r2: T</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Merge two accumulated values together.</p><div class="fullcomment"><div class="comment cmt"><p>Merge two accumulated values together. Is allowed to modify and return the first value +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt class="param">r1</dt><dd class="cmt"><p>one set of accumulated data</p></dd><dt class="param">r2</dt><dd class="cmt"><p>another set of accumulated data</p></dd><dt>returns</dt><dd class="cmt"><p>both data sets merged together +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li><li visbl="pub" name="spark.AccumulableParam#zero" data-isabs="true"> + <a id="zero(T):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zero</span><span class="params">(<span name="initialValue">initialValue: T</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Return the "zero" (identity) value for an accumulator type, given its initial value.</p><div class="fullcomment"><div class="comment cmt"><p>Return the "zero" (identity) value for an accumulator type, given its initial value. For +example, if R was a vector of N dimensions, this would return a vector of N zeroes. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.AccumulatorParam#addAccumulator" data-isabs="false"> + <a id="addAccumulator(T,T):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addAccumulator</span><span class="params">(<span name="t1">t1: T</span>, <span name="t2">t2: T</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Add additional data to the accumulator value.</p><div class="fullcomment"><div class="comment cmt"><p>Add additional data to the accumulator value. Is allowed to modify and return <code>r</code> +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt>returns</dt><dd class="cmt"><p>the new value of the accumulator +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.AccumulatorParam" class="extype" href="">AccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.AccumulableParam" class="parent"> + <h3>Inherited from <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a>[T, T]</h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/Aggregator.html b/site/docs/0.7.0/api/core/spark/Aggregator.html new file mode 100644 index 000000000..53cab58cb --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/Aggregator.html @@ -0,0 +1,519 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.Aggregator</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>Aggregator</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">case class</span> + </span> + <span class="symbol"> + <span class="name">Aggregator</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>, <span name="C">C</span>]</span><span class="params">(<span name="createCombiner">createCombiner: (V) ⇒ C</span>, <span name="mergeValue">mergeValue: (C, V) ⇒ C</span>, <span name="mergeCombiners">mergeCombiners: (C, C) ⇒ C</span>)</span><span class="result"> extends <span name="scala.Product" class="extype">Product</span> with <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A set of functions used to aggregate data. +</p></div><dl class="paramcmts block"><dt class="param">createCombiner</dt><dd class="cmt"><p>function to create the initial value of the aggregation.</p></dd><dt class="param">mergeValue</dt><dd class="cmt"><p>function to merge a new value into the aggregation result.</p></dd><dt class="param">mergeCombiners</dt><dd class="cmt"><p>function to merge outputs from multiple mergeValue function. +</p></dd></dl><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.Aggregator" class="in"><span>Aggregator</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.Aggregator#this" data-isabs="false"> + <a id="this:Aggregator[K, V, C]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">Aggregator</span><span class="params">(<span name="createCombiner">createCombiner: (V) ⇒ C</span>, <span name="mergeValue">mergeValue: (C, V) ⇒ C</span>, <span name="mergeCombiners">mergeCombiners: (C, C) ⇒ C</span>)</span> + </span> + </h4> + <p class="shortcomment cmt"></p><div class="fullcomment"><div class="comment cmt"></div><dl class="paramcmts block"><dt class="param">createCombiner</dt><dd class="cmt"><p>function to create the initial value of the aggregation.</p></dd><dt class="param">mergeValue</dt><dd class="cmt"><p>function to merge a new value into the aggregation result.</p></dd><dt class="param">mergeCombiners</dt><dd class="cmt"><p>function to merge outputs from multiple mergeValue function. +</p></dd></dl></div> + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.Aggregator#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Aggregator" class="extype" href="">Aggregator</a> → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.Aggregator#combineCombinersByKey" data-isabs="false"> + <a id="combineCombinersByKey(Iterator[(K, C)]):Iterator[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">combineCombinersByKey</span><span class="params">(<span name="iter">iter: Iterator[(K, C)]</span>)</span><span class="result">: Iterator[(K, C)]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.Aggregator#combineValuesByKey" data-isabs="false"> + <a id="combineValuesByKey(Iterator[(K, V)]):Iterator[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">combineValuesByKey</span><span class="params">(<span name="iter">iter: Iterator[(K, V)]</span>)</span><span class="result">: Iterator[(K, C)]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.Aggregator#createCombiner" data-isabs="false"> + <a id="createCombiner:(V) ⇒ C"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">createCombiner</span><span class="result">: (V) ⇒ C</span> + </span> + </h4> + <p class="shortcomment cmt">function to create the initial value of the aggregation.</p> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.Aggregator#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Aggregator" class="extype" href="">Aggregator</a> → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.Aggregator#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Aggregator" class="extype" href="">Aggregator</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.Aggregator#mergeCombiners" data-isabs="false"> + <a id="mergeCombiners:(C, C) ⇒ C"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">mergeCombiners</span><span class="result">: (C, C) ⇒ C</span> + </span> + </h4> + <p class="shortcomment cmt">function to merge outputs from multiple mergeValue function.</p> + </li><li visbl="pub" name="spark.Aggregator#mergeValue" data-isabs="false"> + <a id="mergeValue:(C, V) ⇒ C"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">mergeValue</span><span class="result">: (C, V) ⇒ C</span> + </span> + </h4> + <p class="shortcomment cmt">function to merge a new value into the aggregation result.</p> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.Aggregator#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Aggregator" class="extype" href="">Aggregator</a> → Product</dd></dl></div> + </li><li visbl="pub" name="spark.Aggregator#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Aggregator" class="extype" href="">Aggregator</a> → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="spark.Aggregator#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Aggregator" class="extype" href="">Aggregator</a> → Product</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.Aggregator#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Aggregator" class="extype" href="">Aggregator</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/Dependency.html b/site/docs/0.7.0/api/core/spark/Dependency.html new file mode 100644 index 000000000..34946c6c4 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/Dependency.html @@ -0,0 +1,390 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.Dependency</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>Dependency</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">Dependency</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Base class for dependencies. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div><div class="toggleContainer block"> + <span class="toggle">Known Subclasses</span> + <div class="subClasses hiddenContent"><a name="spark.NarrowDependency" class="extype" href="NarrowDependency.html">NarrowDependency</a>, <a name="spark.OneToOneDependency" class="extype" href="OneToOneDependency.html">OneToOneDependency</a>, <a name="spark.rdd.PruneDependency" class="extype" href="rdd/PruneDependency.html">PruneDependency</a>, <a name="spark.RangeDependency" class="extype" href="RangeDependency.html">RangeDependency</a>, <a name="spark.ShuffleDependency" class="extype" href="ShuffleDependency.html">ShuffleDependency</a></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.Dependency" class="in"><span>Dependency</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.Dependency#this" data-isabs="false"> + <a id="this:Dependency[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">Dependency</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.Dependency#rdd" data-isabs="false"> + <a id="rdd:RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">rdd</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/DoubleRDDFunctions.html b/site/docs/0.7.0/api/core/spark/DoubleRDDFunctions.html new file mode 100644 index 000000000..fdef0855e --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/DoubleRDDFunctions.html @@ -0,0 +1,620 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.DoubleRDDFunctions</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>DoubleRDDFunctions</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">DoubleRDDFunctions</span><span class="result"> extends <a name="spark.Logging" class="extype" href="Logging.html">Logging</a> with <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Extra functions available on RDDs of Doubles through an implicit conversion. +Import <code>spark.SparkContext._</code> at the top of your program to use these functions. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <a name="spark.Logging" class="extype" href="Logging.html">Logging</a>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.DoubleRDDFunctions" class="in"><span>DoubleRDDFunctions</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.DoubleRDDFunctions#this" data-isabs="false"> + <a id="this:DoubleRDDFunctions"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">DoubleRDDFunctions</span><span class="params">(<span name="self">self: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[<span name="scala.Double" class="extype">Double</span>]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.DoubleRDDFunctions#mean" data-isabs="false"> + <a id="mean():Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mean</span><span class="params">()</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Compute the mean of this RDD's elements.</p> + </li><li visbl="pub" name="spark.DoubleRDDFunctions#meanApprox" data-isabs="false"> + <a id="meanApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">meanApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate operation to return the mean within a timeout.</p> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.DoubleRDDFunctions#sampleStdev" data-isabs="false"> + <a id="sampleStdev():Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sampleStdev</span><span class="params">()</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Compute the sample standard deviation of this RDD's elements (which corrects for bias in +estimating the standard deviation by dividing by N-1 instead of N).</p> + </li><li visbl="pub" name="spark.DoubleRDDFunctions#stats" data-isabs="false"> + <a id="stats():StatCounter"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">stats</span><span class="params">()</span><span class="result">: <a name="spark.util.StatCounter" class="extype" href="util/StatCounter.html">StatCounter</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return a <a name="spark.util.StatCounter" class="extype" href="util/StatCounter.html">StatCounter</a> object that captures the mean, variance and count +of the RDD's elements in one operation.</p> + </li><li visbl="pub" name="spark.DoubleRDDFunctions#stdev" data-isabs="false"> + <a id="stdev():Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">stdev</span><span class="params">()</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Compute the standard deviation of this RDD's elements.</p> + </li><li visbl="pub" name="spark.DoubleRDDFunctions#sum" data-isabs="false"> + <a id="sum():Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sum</span><span class="params">()</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Add up the elements in this RDD.</p> + </li><li visbl="pub" name="spark.DoubleRDDFunctions#sumApprox" data-isabs="false"> + <a id="sumApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sumApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate operation to return the sum within a timeout.</p> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.DoubleRDDFunctions#variance" data-isabs="false"> + <a id="variance():Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">variance</span><span class="params">()</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Compute the variance of this RDD's elements.</p> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="Logging.html">Logging</a></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/HashPartitioner.html b/site/docs/0.7.0/api/core/spark/HashPartitioner.html new file mode 100644 index 000000000..8ea52e318 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/HashPartitioner.html @@ -0,0 +1,403 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.HashPartitioner</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>HashPartitioner</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">HashPartitioner</span><span class="result"> extends <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a> that implements hash-based partitioning using Java's <code>Object.hashCode</code>.</p><p>Java arrays have hashCodes that are based on the arrays' identities rather than their contents, +so attempting to partition an RDD[Array[_]] or RDD[(Array[_], _)] using a HashPartitioner will +produce an unexpected or incorrect result. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a>, <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.HashPartitioner" class="in"><span>HashPartitioner</span></li><li name="spark.Partitioner" class="in"><span>Partitioner</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.HashPartitioner#this" data-isabs="false"> + <a id="this:HashPartitioner"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">HashPartitioner</span><span class="params">(<span name="partitions">partitions: <span name="scala.Int" class="extype">Int</span></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.HashPartitioner#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="other">other: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.HashPartitioner" class="extype" href="">HashPartitioner</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.HashPartitioner#getPartition" data-isabs="false"> + <a id="getPartition(Any):Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPartition</span><span class="params">(<span name="key">key: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.HashPartitioner" class="extype" href="">HashPartitioner</a> → <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.HashPartitioner#numPartitions" data-isabs="false"> + <a id="numPartitions:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">numPartitions</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.HashPartitioner" class="extype" href="">HashPartitioner</a> → <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.Partitioner" class="parent"> + <h3>Inherited from <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/JavaSerializer.html b/site/docs/0.7.0/api/core/spark/JavaSerializer.html new file mode 100644 index 000000000..97eee9c3d --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/JavaSerializer.html @@ -0,0 +1,385 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.JavaSerializer</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>JavaSerializer</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">JavaSerializer</span><span class="result"> extends <a name="spark.serializer.Serializer" class="extype" href="serializer/Serializer.html">Serializer</a></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A Spark serializer that uses Java's built-in serialization. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.serializer.Serializer" class="extype" href="serializer/Serializer.html">Serializer</a>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.JavaSerializer" class="in"><span>JavaSerializer</span></li><li name="spark.serializer.Serializer" class="in"><span>Serializer</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.JavaSerializer#this" data-isabs="false"> + <a id="this:JavaSerializer"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">JavaSerializer</span><span class="params">()</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.JavaSerializer#newInstance" data-isabs="false"> + <a id="newInstance():SerializerInstance"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">newInstance</span><span class="params">()</span><span class="result">: <a name="spark.serializer.SerializerInstance" class="extype" href="serializer/SerializerInstance.html">SerializerInstance</a></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.JavaSerializer" class="extype" href="">JavaSerializer</a> → <a name="spark.serializer.Serializer" class="extype" href="serializer/Serializer.html">Serializer</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.serializer.Serializer" class="parent"> + <h3>Inherited from <a name="spark.serializer.Serializer" class="extype" href="serializer/Serializer.html">Serializer</a></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/KryoRegistrator.html b/site/docs/0.7.0/api/core/spark/KryoRegistrator.html new file mode 100644 index 000000000..27f706754 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/KryoRegistrator.html @@ -0,0 +1,372 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.KryoRegistrator</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/trait_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>KryoRegistrator</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <span class="name">KryoRegistrator</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Interface implemented by clients to register their classes with Kryo when using Kryo +serialization. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent">AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.KryoRegistrator" class="in"><span>KryoRegistrator</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.KryoRegistrator#registerClasses" data-isabs="true"> + <a id="registerClasses(Kryo):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">registerClasses</span><span class="params">(<span name="kryo">kryo: <span name="com.esotericsoftware.kryo.Kryo" class="extype">Kryo</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/KryoSerializer.html b/site/docs/0.7.0/api/core/spark/KryoSerializer.html new file mode 100644 index 000000000..ac8b53ea2 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/KryoSerializer.html @@ -0,0 +1,591 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.KryoSerializer</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>KryoSerializer</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">KryoSerializer</span><span class="result"> extends <a name="spark.serializer.Serializer" class="extype" href="serializer/Serializer.html">Serializer</a> with <a name="spark.Logging" class="extype" href="Logging.html">Logging</a></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A Spark serializer that uses the <a href="http://code.google.com/p/kryo/wiki/V1Documentation">Kryo 1.x library</a>. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.Logging" class="extype" href="Logging.html">Logging</a>, <a name="spark.serializer.Serializer" class="extype" href="serializer/Serializer.html">Serializer</a>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.KryoSerializer" class="in"><span>KryoSerializer</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="spark.serializer.Serializer" class="in"><span>Serializer</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.KryoSerializer#this" data-isabs="false"> + <a id="this:KryoSerializer"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">KryoSerializer</span><span class="params">()</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.KryoSerializer#bufferSize" data-isabs="false"> + <a id="bufferSize:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">bufferSize</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.KryoSerializer#createKryo" data-isabs="false"> + <a id="createKryo():Kryo"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">createKryo</span><span class="params">()</span><span class="result">: <span name="com.esotericsoftware.kryo.Kryo" class="extype">Kryo</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.KryoSerializer#input" data-isabs="false"> + <a id="input:ThreadLocal[Input]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">input</span><span class="result">: <span name="java.lang.ThreadLocal" class="extype">ThreadLocal</span>[<span name="com.esotericsoftware.kryo.io.Input" class="extype">Input</span>]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.KryoSerializer#kryo" data-isabs="false"> + <a id="kryo:ThreadLocal[Kryo]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">kryo</span><span class="result">: <span name="java.lang.ThreadLocal" class="extype">ThreadLocal</span>[<span name="com.esotericsoftware.kryo.Kryo" class="extype">Kryo</span>]</span> + </span> + </h4> + + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.KryoSerializer#newInstance" data-isabs="false"> + <a id="newInstance():SerializerInstance"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">newInstance</span><span class="params">()</span><span class="result">: <a name="spark.serializer.SerializerInstance" class="extype" href="serializer/SerializerInstance.html">SerializerInstance</a></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.KryoSerializer" class="extype" href="">KryoSerializer</a> → <a name="spark.serializer.Serializer" class="extype" href="serializer/Serializer.html">Serializer</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.KryoSerializer#output" data-isabs="false"> + <a id="output:ThreadLocal[Output]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">output</span><span class="result">: <span name="java.lang.ThreadLocal" class="extype">ThreadLocal</span>[<span name="com.esotericsoftware.kryo.io.Output" class="extype">Output</span>]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="Logging.html">Logging</a></h3> + </div><div name="spark.serializer.Serializer" class="parent"> + <h3>Inherited from <a name="spark.serializer.Serializer" class="extype" href="serializer/Serializer.html">Serializer</a></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/Logging.html b/site/docs/0.7.0/api/core/spark/Logging.html new file mode 100644 index 000000000..61abe836a --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/Logging.html @@ -0,0 +1,505 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.Logging</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/trait_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>Logging</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <span class="name">Logging</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Utility trait for classes that want to log data. Creates a SLF4J logger for the class and allows +logging messages at different levels using methods that only evaluate parameters lazily if the +log level is enabled. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent">AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div><div class="toggleContainer block"> + <span class="toggle">Known Subclasses</span> + <div class="subClasses hiddenContent"><a name="spark.rdd.CoGroupedRDD" class="extype" href="rdd/CoGroupedRDD.html">CoGroupedRDD</a>, <a name="spark.rdd.CoalescedRDD" class="extype" href="rdd/CoalescedRDD.html">CoalescedRDD</a>, <a name="spark.DoubleRDDFunctions" class="extype" href="DoubleRDDFunctions.html">DoubleRDDFunctions</a>, <a name="spark.rdd.HadoopRDD" class="extype" href="rdd/HadoopRDD.html">HadoopRDD</a>, <a name="org.apache.hadoop.mapred.HadoopWriter" class="extype" href="../org/apache/hadoop/mapred/HadoopWriter.html">HadoopWriter</a>, <a name="spark.KryoSerializer" class="extype" href="KryoSerializer.html">KryoSerializer</a>, <a name="spark.util.MetadataCleaner" class="extype" href="util/MetadataCleaner.html">MetadataCleaner</a>, <a name="spark.rdd.NewHadoopRDD" class="extype" href="rdd/NewHadoopRDD.html">NewHadoopRDD</a>, <a name="spark.OrderedRDDFunctions" class="extype" href="OrderedRDDFunctions.html">OrderedRDDFunctions</a>, <a name="spark.PairRDDFunctions" class="extype" href="PairRDDFunctions.html">PairRDDFunctions</a>, <a name="spark.rdd.PartitionPruningRDD" class="extype" href="rdd/PartitionPruningRDD.html">PartitionPruningRDD</a>, <a name="spark.rdd.PipedRDD" class="extype" href="rdd/PipedRDD.html">PipedRDD</a>, <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>, <a name="spark.rdd.SampledRDD" class="extype" href="rdd/SampledRDD.html">SampledRDD</a>, <a name="spark.SequenceFileRDDFunctions" class="extype" href="SequenceFileRDDFunctions.html">SequenceFileRDDFunctions</a>, <a name="spark.rdd.ShuffledRDD" class="extype" href="rdd/ShuffledRDD.html">ShuffledRDD</a>, <a name="spark.SparkContext" class="extype" href="SparkContext.html">SparkContext</a>, <a name="spark.SparkEnv" class="extype" href="SparkEnv$.html">SparkEnv</a>, <a name="spark.util.TimeStampedHashMap" class="extype" href="util/TimeStampedHashMap.html">TimeStampedHashMap</a>, <a name="spark.rdd.UnionRDD" class="extype" href="rdd/UnionRDD.html">UnionRDD</a>, <a name="spark.rdd.ZippedRDD" class="extype" href="rdd/ZippedRDD.html">ZippedRDD</a></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/NarrowDependency.html b/site/docs/0.7.0/api/core/spark/NarrowDependency.html new file mode 100644 index 000000000..92018e212 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/NarrowDependency.html @@ -0,0 +1,397 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.NarrowDependency</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>NarrowDependency</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">NarrowDependency</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <a name="spark.Dependency" class="extype" href="Dependency.html">Dependency</a>[T]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Base class for dependencies where each partition of the parent RDD is used by at most one +partition of the child RDD. Narrow dependencies allow for pipelined execution. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.Dependency" class="extype" href="Dependency.html">Dependency</a>[T], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div><div class="toggleContainer block"> + <span class="toggle">Known Subclasses</span> + <div class="subClasses hiddenContent"><a name="spark.OneToOneDependency" class="extype" href="OneToOneDependency.html">OneToOneDependency</a>, <a name="spark.rdd.PruneDependency" class="extype" href="rdd/PruneDependency.html">PruneDependency</a>, <a name="spark.RangeDependency" class="extype" href="RangeDependency.html">RangeDependency</a></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.NarrowDependency" class="in"><span>NarrowDependency</span></li><li name="spark.Dependency" class="in"><span>Dependency</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.NarrowDependency#this" data-isabs="false"> + <a id="this:NarrowDependency[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">NarrowDependency</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.NarrowDependency#getParents" data-isabs="true"> + <a id="getParents(Int):Seq[Int]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getParents</span><span class="params">(<span name="partitionId">partitionId: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: Seq[<span name="scala.Int" class="extype">Int</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the parent partitions for a child partition.</p><div class="fullcomment"><div class="comment cmt"><p>Get the parent partitions for a child partition.</p></div><dl class="paramcmts block"><dt class="param">partitionId</dt><dd class="cmt"><p>a partition of the child RDD</p></dd><dt>returns</dt><dd class="cmt"><p>the partitions of the parent RDD that the child partition depends upon +</p></dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.Dependency" class="parent"> + <h3>Inherited from <a name="spark.Dependency" class="extype" href="Dependency.html">Dependency</a>[T]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/OneToOneDependency.html b/site/docs/0.7.0/api/core/spark/OneToOneDependency.html new file mode 100644 index 000000000..732e1761f --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/OneToOneDependency.html @@ -0,0 +1,392 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.OneToOneDependency</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>OneToOneDependency</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">OneToOneDependency</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <a name="spark.NarrowDependency" class="extype" href="NarrowDependency.html">NarrowDependency</a>[T]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Represents a one-to-one dependency between partitions of the parent and child RDDs. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.NarrowDependency" class="extype" href="NarrowDependency.html">NarrowDependency</a>[T], <a name="spark.Dependency" class="extype" href="Dependency.html">Dependency</a>[T], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.OneToOneDependency" class="in"><span>OneToOneDependency</span></li><li name="spark.NarrowDependency" class="in"><span>NarrowDependency</span></li><li name="spark.Dependency" class="in"><span>Dependency</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.OneToOneDependency#this" data-isabs="false"> + <a id="this:OneToOneDependency[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">OneToOneDependency</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.OneToOneDependency#getParents" data-isabs="false"> + <a id="getParents(Int):List[Int]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getParents</span><span class="params">(<span name="partitionId">partitionId: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.immutable.List" class="extype">List</span>[<span name="scala.Int" class="extype">Int</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the parent partitions for a child partition.</p><div class="fullcomment"><div class="comment cmt"><p>Get the parent partitions for a child partition.</p></div><dl class="paramcmts block"><dt class="param">partitionId</dt><dd class="cmt"><p>a partition of the child RDD</p></dd><dt>returns</dt><dd class="cmt"><p>the partitions of the parent RDD that the child partition depends upon +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.OneToOneDependency" class="extype" href="">OneToOneDependency</a> → <a name="spark.NarrowDependency" class="extype" href="NarrowDependency.html">NarrowDependency</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.NarrowDependency" class="parent"> + <h3>Inherited from <a name="spark.NarrowDependency" class="extype" href="NarrowDependency.html">NarrowDependency</a>[T]</h3> + </div><div name="spark.Dependency" class="parent"> + <h3>Inherited from <a name="spark.Dependency" class="extype" href="Dependency.html">Dependency</a>[T]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/OrderedRDDFunctions.html b/site/docs/0.7.0/api/core/spark/OrderedRDDFunctions.html new file mode 100644 index 000000000..56700313e --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/OrderedRDDFunctions.html @@ -0,0 +1,539 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.OrderedRDDFunctions</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>OrderedRDDFunctions</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">OrderedRDDFunctions</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends <a name="spark.Logging" class="extype" href="Logging.html">Logging</a> with <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Extra functions available on RDDs of (key, value) pairs where the key is sortable through +an implicit conversion. Import <code>spark.SparkContext._</code> at the top of your program to use these +functions. They will work with any key type that has a <code>scala.math.Ordered</code> implementation. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <a name="spark.Logging" class="extype" href="Logging.html">Logging</a>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.OrderedRDDFunctions" class="in"><span>OrderedRDDFunctions</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.OrderedRDDFunctions#this" data-isabs="false"> + <a id="this:OrderedRDDFunctions[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">OrderedRDDFunctions</span><span class="params">(<span name="self">self: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: (K) ⇒ Ordered[K]</span>, <span name="arg1">arg1: ClassManifest[K]</span>, <span name="arg2">arg2: ClassManifest[V]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.OrderedRDDFunctions#sortByKey" data-isabs="false"> + <a id="sortByKey(Boolean,Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sortByKey</span><span class="params">(<span name="ascending">ascending: <span name="scala.Boolean" class="extype">Boolean</span> = <span class="symbol">true</span></span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span> = <span class="symbol"><span class="name"><a href="RDD.html#partitions:Array[Partition]">self.partitions.size</a></span></span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Sort the RDD by key, so that each partition contains a sorted range of the elements.</p><div class="fullcomment"><div class="comment cmt"><p>Sort the RDD by key, so that each partition contains a sorted range of the elements. Calling +<code>collect</code> or <code>save</code> on the resulting RDD will return or output an ordered list of records +(in the <code>save</code> case, they will be written to multiple <code>part-X</code> files in the filesystem, in +order of the keys). +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="Logging.html">Logging</a></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/PairRDDFunctions.html b/site/docs/0.7.0/api/core/spark/PairRDDFunctions.html new file mode 100644 index 000000000..67e259a44 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/PairRDDFunctions.html @@ -0,0 +1,1143 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.PairRDDFunctions</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>PairRDDFunctions</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">PairRDDFunctions</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends <a name="spark.Logging" class="extype" href="Logging.html">Logging</a> with <a name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil" class="extype" href="../org/apache/hadoop/mapreduce/HadoopMapReduceUtil.html">HadoopMapReduceUtil</a> with <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Extra functions available on RDDs of (key, value) pairs through an implicit conversion. +Import <code>spark.SparkContext._</code> at the top of your program to use these functions. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <a name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil" class="extype" href="../org/apache/hadoop/mapreduce/HadoopMapReduceUtil.html">HadoopMapReduceUtil</a>, <a name="spark.Logging" class="extype" href="Logging.html">Logging</a>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.PairRDDFunctions" class="in"><span>PairRDDFunctions</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil" class="in"><span>HadoopMapReduceUtil</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.PairRDDFunctions#this" data-isabs="false"> + <a id="this:PairRDDFunctions[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">PairRDDFunctions</span><span class="params">(<span name="self">self: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>, <span name="arg1">arg1: ClassManifest[V]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#cogroup" data-isabs="false"> + <a id="cogroup[W1, W2](RDD[(K, W1)],RDD[(K, W2)],Int):RDD[(K, (Seq[V], Seq[W1], Seq[W2]))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cogroup</span><span class="tparams">[<span name="W1">W1</span>, <span name="W2">W2</span>]</span><span class="params">(<span name="other1">other1: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W1)]</span>, <span name="other2">other2: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W2)]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (Seq[V], Seq[W1], Seq[W2]))]</span> + </span> + </h4> + <p class="shortcomment cmt">For each key k in <code>this</code> or <code>other1</code> or <code>other2</code>, return a resulting RDD that contains a +tuple with the list of values for that key in <code>this</code>, <code>other1</code> and <code>other2</code>.</p> + </li><li visbl="pub" name="spark.PairRDDFunctions#cogroup" data-isabs="false"> + <a id="cogroup[W](RDD[(K, W)],Int):RDD[(K, (Seq[V], Seq[W]))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cogroup</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W)]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (Seq[V], Seq[W]))]</span> + </span> + </h4> + <p class="shortcomment cmt">For each key k in <code>this</code> or <code>other</code>, return a resulting RDD that contains a tuple with the +list of values for that key in <code>this</code> as well as <code>other</code>.</p> + </li><li visbl="pub" name="spark.PairRDDFunctions#cogroup" data-isabs="false"> + <a id="cogroup[W1, W2](RDD[(K, W1)],RDD[(K, W2)]):RDD[(K, (Seq[V], Seq[W1], Seq[W2]))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cogroup</span><span class="tparams">[<span name="W1">W1</span>, <span name="W2">W2</span>]</span><span class="params">(<span name="other1">other1: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W1)]</span>, <span name="other2">other2: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W2)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (Seq[V], Seq[W1], Seq[W2]))]</span> + </span> + </h4> + <p class="shortcomment cmt">For each key k in <code>this</code> or <code>other1</code> or <code>other2</code>, return a resulting RDD that contains a +tuple with the list of values for that key in <code>this</code>, <code>other1</code> and <code>other2</code>.</p> + </li><li visbl="pub" name="spark.PairRDDFunctions#cogroup" data-isabs="false"> + <a id="cogroup[W](RDD[(K, W)]):RDD[(K, (Seq[V], Seq[W]))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cogroup</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (Seq[V], Seq[W]))]</span> + </span> + </h4> + <p class="shortcomment cmt">For each key k in <code>this</code> or <code>other</code>, return a resulting RDD that contains a tuple with the +list of values for that key in <code>this</code> as well as <code>other</code>.</p> + </li><li visbl="pub" name="spark.PairRDDFunctions#cogroup" data-isabs="false"> + <a id="cogroup[W1, W2](RDD[(K, W1)],RDD[(K, W2)],Partitioner):RDD[(K, (Seq[V], Seq[W1], Seq[W2]))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cogroup</span><span class="tparams">[<span name="W1">W1</span>, <span name="W2">W2</span>]</span><span class="params">(<span name="other1">other1: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W1)]</span>, <span name="other2">other2: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W2)]</span>, <span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (Seq[V], Seq[W1], Seq[W2]))]</span> + </span> + </h4> + <p class="shortcomment cmt">For each key k in <code>this</code> or <code>other1</code> or <code>other2</code>, return a resulting RDD that contains a +tuple with the list of values for that key in <code>this</code>, <code>other1</code> and <code>other2</code>.</p> + </li><li visbl="pub" name="spark.PairRDDFunctions#cogroup" data-isabs="false"> + <a id="cogroup[W](RDD[(K, W)],Partitioner):RDD[(K, (Seq[V], Seq[W]))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cogroup</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W)]</span>, <span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (Seq[V], Seq[W]))]</span> + </span> + </h4> + <p class="shortcomment cmt">For each key k in <code>this</code> or <code>other</code>, return a resulting RDD that contains a tuple with the +list of values for that key in <code>this</code> as well as <code>other</code>.</p> + </li><li visbl="pub" name="spark.PairRDDFunctions#collectAsMap" data-isabs="false"> + <a id="collectAsMap():Map[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collectAsMap</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the key-value pairs in this RDD to the master as a Map.</p> + </li><li visbl="pub" name="spark.PairRDDFunctions#combineByKey" data-isabs="false"> + <a id="combineByKey[C]((V) ⇒ C,(C, V) ⇒ C,(C, C) ⇒ C):RDD[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">combineByKey</span><span class="tparams">[<span name="C">C</span>]</span><span class="params">(<span name="createCombiner">createCombiner: (V) ⇒ C</span>, <span name="mergeValue">mergeValue: (C, V) ⇒ C</span>, <span name="mergeCombiners">mergeCombiners: (C, C) ⇒ C</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Simplified version of combineByKey that hash-partitions the resulting RDD using the +existing partitioner/parallelism level.</p> + </li><li visbl="pub" name="spark.PairRDDFunctions#combineByKey" data-isabs="false"> + <a id="combineByKey[C]((V) ⇒ C,(C, V) ⇒ C,(C, C) ⇒ C,Int):RDD[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">combineByKey</span><span class="tparams">[<span name="C">C</span>]</span><span class="params">(<span name="createCombiner">createCombiner: (V) ⇒ C</span>, <span name="mergeValue">mergeValue: (C, V) ⇒ C</span>, <span name="mergeCombiners">mergeCombiners: (C, C) ⇒ C</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Simplified version of combineByKey that hash-partitions the output RDD.</p> + </li><li visbl="pub" name="spark.PairRDDFunctions#combineByKey" data-isabs="false"> + <a id="combineByKey[C]((V) ⇒ C,(C, V) ⇒ C,(C, C) ⇒ C,Partitioner,Boolean):RDD[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">combineByKey</span><span class="tparams">[<span name="C">C</span>]</span><span class="params">(<span name="createCombiner">createCombiner: (V) ⇒ C</span>, <span name="mergeValue">mergeValue: (C, V) ⇒ C</span>, <span name="mergeCombiners">mergeCombiners: (C, C) ⇒ C</span>, <span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span>, <span name="mapSideCombine">mapSideCombine: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Generic function to combine the elements for each key using a custom set of aggregation +functions.</p><div class="fullcomment"><div class="comment cmt"><p>Generic function to combine the elements for each key using a custom set of aggregation +functions. Turns an RDD[(K, V)] into a result of type RDD[(K, C)], for a "combined type" C +Note that V and C can be different -- for example, one might group an RDD of type +(Int, Int) into an RDD of type (Int, Seq[Int]). Users provide three functions:</p><p>- <code>createCombiner</code>, which turns a V into a C (e.g., creates a one-element list) +- <code>mergeValue</code>, to merge a V into a C (e.g., adds it to the end of a list) +- <code>mergeCombiners</code>, to combine two C's into a single one.</p><p>In addition, users can control the partitioning of the output RDD, and whether to perform +map-side aggregation (if a mapper can produce multiple items with the same key). +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#countByKey" data-isabs="false"> + <a id="countByKey():Map[K, Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByKey</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[K, <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Count the number of elements for each key, and return the result to the master as a Map.</p> + </li><li visbl="pub" name="spark.PairRDDFunctions#countByKeyApprox" data-isabs="false"> + <a id="countByKeyApprox(Long,Double):PartialResult[Map[K, BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByKeyApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="partial/PartialResult.html">PartialResult</a>[<span name="scala.collection.Map" class="extype">Map</span>[K, <a name="spark.partial.BoundedDouble" class="extype" href="partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByKey that can return a partial result if it does +not finish within a timeout.</p> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#flatMapValues" data-isabs="false"> + <a id="flatMapValues[U]((V) ⇒ TraversableOnce[U]):RDD[(K, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMapValues</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (V) ⇒ TraversableOnce[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Pass each value in the key-value pair RDD through a flatMap function without changing the +keys; this also retains the original RDD's partitioning.</p> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#groupByKey" data-isabs="false"> + <a id="groupByKey():RDD[(K, Seq[V])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupByKey</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, Seq[V])]</span> + </span> + </h4> + <p class="shortcomment cmt">Group the values for each key in the RDD into a single sequence.</p><div class="fullcomment"><div class="comment cmt"><p>Group the values for each key in the RDD into a single sequence. Hash-partitions the +resulting RDD with the existing partitioner/parallelism level. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#groupByKey" data-isabs="false"> + <a id="groupByKey(Int):RDD[(K, Seq[V])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupByKey</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, Seq[V])]</span> + </span> + </h4> + <p class="shortcomment cmt">Group the values for each key in the RDD into a single sequence.</p><div class="fullcomment"><div class="comment cmt"><p>Group the values for each key in the RDD into a single sequence. Hash-partitions the +resulting RDD with into <code>numPartitions</code> partitions. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#groupByKey" data-isabs="false"> + <a id="groupByKey(Partitioner):RDD[(K, Seq[V])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupByKey</span><span class="params">(<span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, Seq[V])]</span> + </span> + </h4> + <p class="shortcomment cmt">Group the values for each key in the RDD into a single sequence.</p><div class="fullcomment"><div class="comment cmt"><p>Group the values for each key in the RDD into a single sequence. Allows controlling the +partitioning of the resulting key-value pair RDD by passing a Partitioner. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#groupWith" data-isabs="false"> + <a id="groupWith[W1, W2](RDD[(K, W1)],RDD[(K, W2)]):RDD[(K, (Seq[V], Seq[W1], Seq[W2]))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupWith</span><span class="tparams">[<span name="W1">W1</span>, <span name="W2">W2</span>]</span><span class="params">(<span name="other1">other1: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W1)]</span>, <span name="other2">other2: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W2)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (Seq[V], Seq[W1], Seq[W2]))]</span> + </span> + </h4> + <p class="shortcomment cmt">Alias for cogroup.</p> + </li><li visbl="pub" name="spark.PairRDDFunctions#groupWith" data-isabs="false"> + <a id="groupWith[W](RDD[(K, W)]):RDD[(K, (Seq[V], Seq[W]))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupWith</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (Seq[V], Seq[W]))]</span> + </span> + </h4> + <p class="shortcomment cmt">Alias for cogroup.</p> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#join" data-isabs="false"> + <a id="join[W](RDD[(K, W)],Int):RDD[(K, (V, W))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">join</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W)]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (V, W))]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD containing all pairs of elements with matching keys in <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD containing all pairs of elements with matching keys in <code>this</code> and <code>other</code>. Each +pair of elements will be returned as a (k, (v1, v2)) tuple, where (k, v1) is in <code>this</code> and +(k, v2) is in <code>other</code>. Performs a hash join across the cluster. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#join" data-isabs="false"> + <a id="join[W](RDD[(K, W)]):RDD[(K, (V, W))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">join</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (V, W))]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD containing all pairs of elements with matching keys in <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD containing all pairs of elements with matching keys in <code>this</code> and <code>other</code>. Each +pair of elements will be returned as a (k, (v1, v2)) tuple, where (k, v1) is in <code>this</code> and +(k, v2) is in <code>other</code>. Performs a hash join across the cluster. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#join" data-isabs="false"> + <a id="join[W](RDD[(K, W)],Partitioner):RDD[(K, (V, W))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">join</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W)]</span>, <span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (V, W))]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD containing all pairs of elements with matching keys in <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD containing all pairs of elements with matching keys in <code>this</code> and <code>other</code>. Each +pair of elements will be returned as a (k, (v1, v2)) tuple, where (k, v1) is in <code>this</code> and +(k, v2) is in <code>other</code>. Uses the given Partitioner to partition the output RDD. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#keys" data-isabs="false"> + <a id="keys:RDD[K]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keys</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[K]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the keys of each tuple.</p> + </li><li visbl="pub" name="spark.PairRDDFunctions#leftOuterJoin" data-isabs="false"> + <a id="leftOuterJoin[W](RDD[(K, W)],Int):RDD[(K, (V, Option[W]))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">leftOuterJoin</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W)]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (V, <span name="scala.Option" class="extype">Option</span>[W]))]</span> + </span> + </h4> + <p class="shortcomment cmt">Perform a left outer join of <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Perform a left outer join of <code>this</code> and <code>other</code>. For each element (k, v) in <code>this</code>, the +resulting RDD will either contain all pairs (k, (v, Some(w))) for w in <code>other</code>, or the +pair (k, (v, None)) if no elements in <code>other</code> have key k. Hash-partitions the output +into <code>numPartitions</code> partitions. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#leftOuterJoin" data-isabs="false"> + <a id="leftOuterJoin[W](RDD[(K, W)]):RDD[(K, (V, Option[W]))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">leftOuterJoin</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (V, <span name="scala.Option" class="extype">Option</span>[W]))]</span> + </span> + </h4> + <p class="shortcomment cmt">Perform a left outer join of <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Perform a left outer join of <code>this</code> and <code>other</code>. For each element (k, v) in <code>this</code>, the +resulting RDD will either contain all pairs (k, (v, Some(w))) for w in <code>other</code>, or the +pair (k, (v, None)) if no elements in <code>other</code> have key k. Hash-partitions the output +using the existing partitioner/parallelism level. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#leftOuterJoin" data-isabs="false"> + <a id="leftOuterJoin[W](RDD[(K, W)],Partitioner):RDD[(K, (V, Option[W]))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">leftOuterJoin</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W)]</span>, <span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (V, <span name="scala.Option" class="extype">Option</span>[W]))]</span> + </span> + </h4> + <p class="shortcomment cmt">Perform a left outer join of <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Perform a left outer join of <code>this</code> and <code>other</code>. For each element (k, v) in <code>this</code>, the +resulting RDD will either contain all pairs (k, (v, Some(w))) for w in <code>other</code>, or the +pair (k, (v, None)) if no elements in <code>other</code> have key k. Uses the given Partitioner to +partition the output RDD. +</p></div></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#lookup" data-isabs="false"> + <a id="lookup(K):Seq[V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">lookup</span><span class="params">(<span name="key">key: K</span>)</span><span class="result">: Seq[V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the list of values in the RDD for key <code>key</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the list of values in the RDD for key <code>key</code>. This operation is done efficiently if the +RDD has a known partitioner by only searching the partition that the key maps to. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#mapValues" data-isabs="false"> + <a id="mapValues[U]((V) ⇒ U):RDD[(K, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapValues</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (V) ⇒ U</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Pass each value in the key-value pair RDD through a map function without changing the keys; +this also retains the original RDD's partitioning.</p> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil#newJobContext" data-isabs="false"> + <a id="newJobContext(Configuration,JobID):JobContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">newJobContext</span><span class="params">(<span name="conf">conf: <span name="org.apache.hadoop.conf.Configuration" class="extype">Configuration</span></span>, <span name="jobId">jobId: <span name="org.apache.hadoop.mapreduce.JobID" class="extype">JobID</span></span>)</span><span class="result">: <span name="org.apache.hadoop.mapreduce.JobContext" class="extype">JobContext</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil" class="extype" href="../org/apache/hadoop/mapreduce/HadoopMapReduceUtil.html">HadoopMapReduceUtil</a></dd></dl></div> + </li><li visbl="pub" name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil#newTaskAttemptContext" data-isabs="false"> + <a id="newTaskAttemptContext(Configuration,TaskAttemptID):TaskAttemptContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">newTaskAttemptContext</span><span class="params">(<span name="conf">conf: <span name="org.apache.hadoop.conf.Configuration" class="extype">Configuration</span></span>, <span name="attemptId">attemptId: <span name="org.apache.hadoop.mapreduce.TaskAttemptID" class="extype">TaskAttemptID</span></span>)</span><span class="result">: <span name="org.apache.hadoop.mapreduce.TaskAttemptContext" class="extype">TaskAttemptContext</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil" class="extype" href="../org/apache/hadoop/mapreduce/HadoopMapReduceUtil.html">HadoopMapReduceUtil</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#partitionBy" data-isabs="false"> + <a id="partitionBy(Partitioner,Boolean):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">partitionBy</span><span class="params">(<span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span>, <span name="mapSideCombine">mapSideCombine: <span name="scala.Boolean" class="extype">Boolean</span> = <span class="symbol">false</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a copy of the RDD partitioned using the specified partitioner.</p><div class="fullcomment"><div class="comment cmt"><p>Return a copy of the RDD partitioned using the specified partitioner. If <code>mapSideCombine</code> +is true, Spark will group values of the same key together on the map side before the +repartitioning, to only send each key over the network once. If a large number of +duplicated keys are expected, and the size of the keys are large, <code>mapSideCombine</code> should +be set to true. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#reduceByKey" data-isabs="false"> + <a id="reduceByKey((V, V) ⇒ V):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceByKey</span><span class="params">(<span name="func">func: (V, V) ⇒ V</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Merge the values for each key using an associative reduce function.</p><div class="fullcomment"><div class="comment cmt"><p>Merge the values for each key using an associative reduce function. This will also perform +the merging locally on each mapper before sending results to a reducer, similarly to a +"combiner" in MapReduce. Output will be hash-partitioned with the existing partitioner/ +parallelism level. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#reduceByKey" data-isabs="false"> + <a id="reduceByKey((V, V) ⇒ V,Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceByKey</span><span class="params">(<span name="func">func: (V, V) ⇒ V</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Merge the values for each key using an associative reduce function.</p><div class="fullcomment"><div class="comment cmt"><p>Merge the values for each key using an associative reduce function. This will also perform +the merging locally on each mapper before sending results to a reducer, similarly to a +"combiner" in MapReduce. Output will be hash-partitioned with numPartitions partitions. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#reduceByKey" data-isabs="false"> + <a id="reduceByKey(Partitioner,(V, V) ⇒ V):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceByKey</span><span class="params">(<span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span>, <span name="func">func: (V, V) ⇒ V</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Merge the values for each key using an associative reduce function.</p><div class="fullcomment"><div class="comment cmt"><p>Merge the values for each key using an associative reduce function. This will also perform +the merging locally on each mapper before sending results to a reducer, similarly to a +"combiner" in MapReduce. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#reduceByKeyLocally" data-isabs="false"> + <a id="reduceByKeyLocally((V, V) ⇒ V):Map[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceByKeyLocally</span><span class="params">(<span name="func">func: (V, V) ⇒ V</span>)</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Merge the values for each key using an associative reduce function, but return the results +immediately to the master as a Map.</p><div class="fullcomment"><div class="comment cmt"><p>Merge the values for each key using an associative reduce function, but return the results +immediately to the master as a Map. This will also perform the merging locally on each mapper +before sending results to a reducer, similarly to a "combiner" in MapReduce. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#reduceByKeyToDriver" data-isabs="false"> + <a id="reduceByKeyToDriver((V, V) ⇒ V):Map[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceByKeyToDriver</span><span class="params">(<span name="func">func: (V, V) ⇒ V</span>)</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Alias for reduceByKeyLocally</p> + </li><li visbl="pub" name="spark.PairRDDFunctions#rightOuterJoin" data-isabs="false"> + <a id="rightOuterJoin[W](RDD[(K, W)],Int):RDD[(K, (Option[V], W))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">rightOuterJoin</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W)]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (<span name="scala.Option" class="extype">Option</span>[V], W))]</span> + </span> + </h4> + <p class="shortcomment cmt">Perform a right outer join of <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Perform a right outer join of <code>this</code> and <code>other</code>. For each element (k, w) in <code>other</code>, the +resulting RDD will either contain all pairs (k, (Some(v), w)) for v in <code>this</code>, or the +pair (k, (None, w)) if no elements in <code>this</code> have key k. Hash-partitions the resulting +RDD into the given number of partitions. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#rightOuterJoin" data-isabs="false"> + <a id="rightOuterJoin[W](RDD[(K, W)]):RDD[(K, (Option[V], W))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">rightOuterJoin</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (<span name="scala.Option" class="extype">Option</span>[V], W))]</span> + </span> + </h4> + <p class="shortcomment cmt">Perform a right outer join of <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Perform a right outer join of <code>this</code> and <code>other</code>. For each element (k, w) in <code>other</code>, the +resulting RDD will either contain all pairs (k, (Some(v), w)) for v in <code>this</code>, or the +pair (k, (None, w)) if no elements in <code>this</code> have key k. Hash-partitions the resulting +RDD using the existing partitioner/parallelism level. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#rightOuterJoin" data-isabs="false"> + <a id="rightOuterJoin[W](RDD[(K, W)],Partitioner):RDD[(K, (Option[V], W))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">rightOuterJoin</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, W)]</span>, <span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, (<span name="scala.Option" class="extype">Option</span>[V], W))]</span> + </span> + </h4> + <p class="shortcomment cmt">Perform a right outer join of <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Perform a right outer join of <code>this</code> and <code>other</code>. For each element (k, w) in <code>other</code>, the +resulting RDD will either contain all pairs (k, (Some(v), w)) for v in <code>this</code>, or the +pair (k, (None, w)) if no elements in <code>this</code> have key k. Uses the given Partitioner to +partition the output RDD. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#saveAsHadoopDataset" data-isabs="false"> + <a id="saveAsHadoopDataset(JobConf):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsHadoopDataset</span><span class="params">(<span name="conf">conf: <span name="org.apache.hadoop.mapred.JobConf" class="extype">JobConf</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Output the RDD to any Hadoop-supported storage system, using a Hadoop JobConf object for +that storage system.</p><div class="fullcomment"><div class="comment cmt"><p>Output the RDD to any Hadoop-supported storage system, using a Hadoop JobConf object for +that storage system. The JobConf should set an OutputFormat and any output paths required +(e.g. a table name to write to) in the same way as it would be configured for a Hadoop +MapReduce job. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#saveAsHadoopFile" data-isabs="false"> + <a id="saveAsHadoopFile(String,Class[_],Class[_],Class[_ <: org.apache.hadoop.mapred.OutputFormat[_, _]],JobConf):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsHadoopFile</span><span class="params">(<span name="path">path: String</span>, <span name="keyClass">keyClass: Class[_]</span>, <span name="valueClass">valueClass: Class[_]</span>, <span name="outputFormatClass">outputFormatClass: Class[_ <: org.apache.hadoop.mapred.OutputFormat[_, _]]</span>, <span name="conf">conf: <span name="org.apache.hadoop.mapred.JobConf" class="extype">JobConf</span> = <span name='<span class="name"><a href="RDD.html#context:SparkContext">new JobConf(self.context.hadoopConfiguration)</a></span>' class="defval">...</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Output the RDD to any Hadoop-supported file system, using a Hadoop <code>OutputFormat</code> class +supporting the key and value types K and V in this RDD.</p> + </li><li visbl="pub" name="spark.PairRDDFunctions#saveAsHadoopFile" data-isabs="false"> + <a id="saveAsHadoopFile[F<:OutputFormat[K, V]](String)(ClassManifest[F]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsHadoopFile</span><span class="tparams">[<span name="F">F <: <span name="org.apache.hadoop.mapred.OutputFormat" class="extype">OutputFormat</span>[K, V]</span>]</span><span class="params">(<span name="path">path: String</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="fm">fm: ClassManifest[F]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Output the RDD to any Hadoop-supported file system, using a Hadoop <code>OutputFormat</code> class +supporting the key and value types K and V in this RDD.</p> + </li><li visbl="pub" name="spark.PairRDDFunctions#saveAsNewAPIHadoopFile" data-isabs="false"> + <a id="saveAsNewAPIHadoopFile(String,Class[_],Class[_],Class[_ <: org.apache.hadoop.mapreduce.OutputFormat[_, _]],Configuration):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsNewAPIHadoopFile</span><span class="params">(<span name="path">path: String</span>, <span name="keyClass">keyClass: Class[_]</span>, <span name="valueClass">valueClass: Class[_]</span>, <span name="outputFormatClass">outputFormatClass: Class[_ <: org.apache.hadoop.mapreduce.OutputFormat[_, _]]</span>, <span name="conf">conf: <span name="org.apache.hadoop.conf.Configuration" class="extype">Configuration</span> = <span class="symbol"><span class="name"><a href="RDD.html#context:SparkContext">self.context.hadoopConfiguration</a></span></span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Output the RDD to any Hadoop-supported file system, using a new Hadoop API <code>OutputFormat</code> +(mapreduce.</p><div class="fullcomment"><div class="comment cmt"><p>Output the RDD to any Hadoop-supported file system, using a new Hadoop API <code>OutputFormat</code> +(mapreduce.OutputFormat) object supporting the key and value types K and V in this RDD. +</p></div></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#saveAsNewAPIHadoopFile" data-isabs="false"> + <a id="saveAsNewAPIHadoopFile[F<:OutputFormat[K, V]](String)(ClassManifest[F]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsNewAPIHadoopFile</span><span class="tparams">[<span name="F">F <: <span name="org.apache.hadoop.mapreduce.OutputFormat" class="extype">OutputFormat</span>[K, V]</span>]</span><span class="params">(<span name="path">path: String</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="fm">fm: ClassManifest[F]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Output the RDD to any Hadoop-supported file system, using a new Hadoop API <code>OutputFormat</code> +(mapreduce.</p><div class="fullcomment"><div class="comment cmt"><p>Output the RDD to any Hadoop-supported file system, using a new Hadoop API <code>OutputFormat</code> +(mapreduce.OutputFormat) object supporting the key and value types K and V in this RDD. +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.PairRDDFunctions#values" data-isabs="false"> + <a id="values:RDD[V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">values</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the values of each tuple.</p> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil" class="parent"> + <h3>Inherited from <a name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil" class="extype" href="../org/apache/hadoop/mapreduce/HadoopMapReduceUtil.html">HadoopMapReduceUtil</a></h3> + </div><div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="Logging.html">Logging</a></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/Partition.html b/site/docs/0.7.0/api/core/spark/Partition.html new file mode 100644 index 000000000..d060831b7 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/Partition.html @@ -0,0 +1,379 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.Partition</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/trait_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>Partition</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <span class="name">Partition</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A partition of an RDD. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div><div class="toggleContainer block"> + <span class="toggle">Known Subclasses</span> + <div class="subClasses hiddenContent"><a name="spark.rdd.PartitionPruningRDDPartition" class="extype" href="rdd/PartitionPruningRDDPartition.html">PartitionPruningRDDPartition</a></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.Partition" class="in"><span>Partition</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.Partition#index" data-isabs="true"> + <a id="index:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">index</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">Get the split's index within its parent RDD +</p> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.Partition#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Partition" class="extype" href="">Partition</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/Partitioner$.html b/site/docs/0.7.0/api/core/spark/Partitioner$.html new file mode 100644 index 000000000..ccf7ab6f9 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/Partitioner$.html @@ -0,0 +1,388 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.Partitioner</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="Partitioner.html"><img src="../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1><a title="Go to companion" href="Partitioner.html">Partitioner</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">Partitioner</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.Partitioner" class="in"><span>Partitioner</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.Partitioner#defaultPartitioner" data-isabs="false"> + <a id="defaultPartitioner(spark.RDD[_],spark.RDD[_]*):Partitioner"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">defaultPartitioner</span><span class="params">(<span name="rdd">rdd: spark.RDD[_]</span>, <span name="others">others: spark.RDD[_]*</span>)</span><span class="result">: <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span> + </span> + </h4> + <p class="shortcomment cmt">Choose a partitioner to use for a cogroup-like operation between a number of RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>Choose a partitioner to use for a cogroup-like operation between a number of RDDs.</p><p>If any of the RDDs already has a partitioner, choose that one.</p><p>Otherwise, we use a default HashPartitioner. For the number of partitions, if +spark.default.parallelism is set, then we'll use the value from SparkContext +defaultParallelism, otherwise we'll use the max number of upstream partitions.</p><p>Unless spark.default.parallelism is set, He number of partitions will be the +same as the number of partitions in the largest upstream RDD, as this should +be least likely to cause out-of-memory errors.</p><p>We use two method parameters (rdd, others) to enforce callers passing at least 1 RDD. +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="spark.Partitioner#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/Partitioner.html b/site/docs/0.7.0/api/core/spark/Partitioner.html new file mode 100644 index 000000000..27fbeca35 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/Partitioner.html @@ -0,0 +1,406 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.Partitioner</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="Partitioner$.html"><img src="../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1><a title="Go to companion" href="Partitioner$.html">Partitioner</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">Partitioner</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>An object that defines how the elements in a key-value pair RDD are partitioned by key. +Maps each key to a partition ID, from 0 to <code>numPartitions - 1</code>. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div><div class="toggleContainer block"> + <span class="toggle">Known Subclasses</span> + <div class="subClasses hiddenContent"><a name="spark.HashPartitioner" class="extype" href="HashPartitioner.html">HashPartitioner</a>, <a name="spark.RangePartitioner" class="extype" href="RangePartitioner.html">RangePartitioner</a></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.Partitioner" class="in"><span>Partitioner</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.Partitioner#this" data-isabs="false"> + <a id="this:Partitioner"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">Partitioner</span><span class="params">()</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.Partitioner#getPartition" data-isabs="true"> + <a id="getPartition(Any):Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPartition</span><span class="params">(<span name="key">key: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.Partitioner#numPartitions" data-isabs="true"> + <a id="numPartitions:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">numPartitions</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/RDD.html b/site/docs/0.7.0/api/core/spark/RDD.html new file mode 100644 index 000000000..b46f3c336 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/RDD.html @@ -0,0 +1,1387 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.RDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>RDD</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">RDD</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span> with <a name="spark.Logging" class="extype" href="Logging.html">Logging</a></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A Resilient Distributed Dataset (RDD), the basic abstraction in Spark. Represents an immutable, +partitioned collection of elements that can be operated on in parallel. This class contains the +basic operations available on all RDDs, such as <code>map</code>, <code>filter</code>, and <code>persist</code>. In addition, +<a name="spark.PairRDDFunctions" class="extype" href="PairRDDFunctions.html">PairRDDFunctions</a> contains operations available only on RDDs of key-value pairs, such +as <code>groupByKey</code> and <code>join</code>; <a name="spark.DoubleRDDFunctions" class="extype" href="DoubleRDDFunctions.html">DoubleRDDFunctions</a> contains operations available only on +RDDs of Doubles; and <a name="spark.SequenceFileRDDFunctions" class="extype" href="SequenceFileRDDFunctions.html">SequenceFileRDDFunctions</a> contains operations available on RDDs +that can be saved as SequenceFiles. These operations are automatically available on any RDD of +the right type (e.g. RDD[(Int, Int)] through implicit conversions when you +<code>import spark.SparkContext._</code>.</p><p>Internally, each RDD is characterized by five main properties:</p><ul><li>A list of partitions</li><li>A function for computing each split</li><li>A list of dependencies on other RDDs</li><li>Optionally, a Partitioner for key-value RDDs (e.g. to say that the RDD is hash-partitioned)</li><li>Optionally, a list of preferred locations to compute each split on (e.g. block locations for + an HDFS file)</li></ul><p>All of the scheduling and execution in Spark is done based on these methods, allowing each RDD +to implement its own way of computing itself. Indeed, users can implement custom RDDs (e.g. for +reading data from a new storage system) by overriding these functions. Please refer to the +<a href="http://www.cs.berkeley.edu/~matei/papers/2012/nsdi_spark.pdf">Spark paper</a> for more details +on RDD internals. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.Logging" class="extype" href="Logging.html">Logging</a>, <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div><div class="toggleContainer block"> + <span class="toggle">Known Subclasses</span> + <div class="subClasses hiddenContent"><a name="spark.rdd.CoGroupedRDD" class="extype" href="rdd/CoGroupedRDD.html">CoGroupedRDD</a>, <a name="spark.rdd.CoalescedRDD" class="extype" href="rdd/CoalescedRDD.html">CoalescedRDD</a>, <a name="spark.rdd.HadoopRDD" class="extype" href="rdd/HadoopRDD.html">HadoopRDD</a>, <a name="spark.rdd.NewHadoopRDD" class="extype" href="rdd/NewHadoopRDD.html">NewHadoopRDD</a>, <a name="spark.rdd.PartitionPruningRDD" class="extype" href="rdd/PartitionPruningRDD.html">PartitionPruningRDD</a>, <a name="spark.rdd.PipedRDD" class="extype" href="rdd/PipedRDD.html">PipedRDD</a>, <a name="spark.rdd.SampledRDD" class="extype" href="rdd/SampledRDD.html">SampledRDD</a>, <a name="spark.rdd.ShuffledRDD" class="extype" href="rdd/ShuffledRDD.html">ShuffledRDD</a>, <a name="spark.rdd.UnionRDD" class="extype" href="rdd/UnionRDD.html">UnionRDD</a>, <a name="spark.rdd.ZippedRDD" class="extype" href="rdd/ZippedRDD.html">ZippedRDD</a></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.RDD" class="in"><span>RDD</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.RDD#this" data-isabs="false"> + <a id="this:RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">RDD</span><span class="params">(<span name="oneParent">oneParent: spark.RDD[_]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span> + </span> + </h4> + <p class="shortcomment cmt">Construct an RDD with just a one-to-one dependency on one parent</p> + </li><li visbl="pub" name="spark.RDD#this" data-isabs="false"> + <a id="this:RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">RDD</span><span class="params">(<span name="sc">sc: <a name="spark.SparkContext" class="extype" href="SparkContext.html">SparkContext</a></span>, <span name="deps">deps: Seq[spark.Dependency[_]]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.RDD#compute" data-isabs="true"> + <a id="compute(Partition,TaskContext):Iterator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compute</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to compute a given partition.</p> + </li><li visbl="prt" name="spark.RDD#getPartitions" data-isabs="true"> + <a id="getPartitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPartitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return the set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return the set of partitions in this RDD. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#++" data-isabs="false"> + <a id="++(RDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#aggregate" data-isabs="false"> + <a id="aggregate[U](U)((U, T) ⇒ U,(U, U) ⇒ U)(ClassManifest[U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: (U, T) ⇒ U</span>, <span name="combOp">combOp: (U, U) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cache" data-isabs="false"> + <a id="cache():RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p> + </li><li visbl="pub" name="spark.RDD#cartesian" data-isabs="false"> + <a id="cartesian[U](RDD[U])(ClassManifest[U]):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p> + </li><li visbl="pub" name="spark.RDD#checkpoint" data-isabs="false"> + <a id="checkpoint():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpoint</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Mark this RDD for checkpointing.</p><div class="fullcomment"><div class="comment cmt"><p>Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint +directory set with SparkContext.setCheckpointDir() and all references to its parent +RDDs will be removed. This function must be called before any job has been +executed on this RDD. It is strongly recommended that this RDD is persisted in +memory, otherwise saving it on a file will require recomputation. +</p></div></div> + </li><li visbl="prt" name="spark.RDD#clearDependencies" data-isabs="false"> + <a id="clearDependencies():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearDependencies</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Clears the dependencies of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Clears the dependencies of this RDD. This method must ensure that all references +to the original parent RDDs is removed to enable the parent RDDs to be garbage +collected. Subclasses of RDD may override this method for implementing their own cleaning +logic. See <a name="spark.rdd.UnionRDD" class="extype" href="rdd/UnionRDD.html">UnionRDD</a> for an example. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#coalesce" data-isabs="false"> + <a id="coalesce(Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">coalesce</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD that is reduced into <code>numPartitions</code> partitions.</p> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect[U](PartialFunction[T, U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[T, U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD that contains all matching values by applying <code>f</code>.</p> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect():Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p> + </li><li visbl="pub" name="spark.RDD#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="SparkContext.html">SparkContext</a> that this RDD was created on.</p> + </li><li visbl="pub" name="spark.RDD#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p> + </li><li visbl="pub" name="spark.RDD#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p> + </li><li visbl="pub" name="spark.RDD#countByValue" data-isabs="false"> + <a id="countByValue():Map[T, Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[T, <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div></div> + </li><li visbl="pub" name="spark.RDD#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[T, BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="partial/PartialResult.html">PartialResult</a>[<span name="scala.collection.Map" class="extype">Map</span>[T, <a name="spark.partial.BoundedDouble" class="extype" href="partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p> + </li><li visbl="pub" name="spark.RDD#dependencies" data-isabs="false"> + <a id="dependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not.</p> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct():RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct(Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#filter" data-isabs="false"> + <a id="filter((T) ⇒ Boolean):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: (T) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#first" data-isabs="false"> + <a id="first():T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p> + </li><li visbl="prt" name="spark.RDD#firstParent" data-isabs="false"> + <a id="firstParent[U](ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">firstParent</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Returns the first parent RDD</p><div class="fullcomment"><div class="comment cmt"><p>Returns the first parent RDD</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="spark" class="extype" href="package.html">spark</a>] </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#flatMap" data-isabs="false"> + <a id="flatMap[U]((T) ⇒ TraversableOnce[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (T) ⇒ TraversableOnce[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p> + </li><li visbl="pub" name="spark.RDD#fold" data-isabs="false"> + <a id="fold(T)((T, T) ⇒ T):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: T</span>)</span><span class="params">(<span name="op">op: (T, T) ⇒ T</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div></div> + </li><li visbl="pub" name="spark.RDD#foreach" data-isabs="false"> + <a id="foreach((T) ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: (T) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p> + </li><li visbl="pub" name="spark.RDD#getCheckpointFile" data-isabs="false"> + <a id="getCheckpointFile:Option[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCheckpointFile</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Gets the name of the file to which this RDD was checkpointed +</p> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.RDD#getDependencies" data-isabs="false"> + <a id="getDependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getDependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return how this RDD depends on parent RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return how this RDD depends on parent RDDs. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="prt" name="spark.RDD#getPreferredLocations" data-isabs="false"> + <a id="getPreferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPreferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify placement preferences.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify placement preferences.</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div></div> + </li><li visbl="pub" name="spark.RDD#glom" data-isabs="false"> + <a id="glom():RDD[Array[T]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[<span name="scala.Array" class="extype">Array</span>[T]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((T) ⇒ K,Partitioner)(ClassManifest[K]):RDD[(K, Seq[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[(K, Seq[T])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((T) ⇒ K,Int)(ClassManifest[K]):RDD[(K, Seq[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[(K, Seq[T])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((T) ⇒ K)(ClassManifest[K]):RDD[(K, Seq[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[(K, Seq[T])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#isCheckpointed" data-isabs="false"> + <a id="isCheckpointed:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isCheckpointed</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return whether this RDD has been checkpointed or not +</p> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#iterator" data-isabs="false"> + <a id="iterator(Partition,TaskContext):Iterator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div></div> + </li><li visbl="pub" name="spark.RDD#keyBy" data-isabs="false"> + <a id="keyBy[K]((T) ⇒ K):RDD[(K, T)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[(K, T)]</span> + </span> + </h4> + <p class="shortcomment cmt">Creates tuples of the elements in this RDD by applying <code>f</code>.</p> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#map" data-isabs="false"> + <a id="map[U]((T) ⇒ U)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (T) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p> + </li><li visbl="pub" name="spark.RDD#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U]((Iterator[T]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (Iterator[T]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p> + </li><li visbl="pub" name="spark.RDD#mapPartitionsWithIndex" data-isabs="false"> + <a id="mapPartitionsWithIndex[U]((Int, Iterator[T]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitionsWithIndex</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[T]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p> + </li><li visbl="pub" name="spark.RDD#name" data-isabs="false"> + <a id="name:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">name</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A friendly name for this RDD</p> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitioner" data-isabs="false"> + <a id="partitioner:Option[Partitioner]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitioner</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[<a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify how they are partitioned.</p> + </li><li visbl="pub" name="spark.RDD#partitions" data-isabs="false"> + <a id="partitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">partitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not.</p> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist():RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String],Map[String, String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>, <span name="env">env: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(String):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p> + </li><li visbl="pub" name="spark.RDD#preferredLocations" data-isabs="false"> + <a id="preferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not.</p> + </li><li visbl="pub" name="spark.RDD#reduce" data-isabs="false"> + <a id="reduce((T, T) ⇒ T):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: (T, T) ⇒ T</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified commutative and associative binary operator.</p> + </li><li visbl="pub" name="spark.RDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p> + </li><li visbl="pub" name="spark.RDD#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p> + </li><li visbl="pub" name="spark.RDD#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p> + </li><li visbl="pub" name="spark.RDD#setName" data-isabs="false"> + <a id="setName(String):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setName</span><span class="params">(<span name="_name">_name: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Assign a name to this RDD</p> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[T],Partitioner):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[T],Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><p>Uses <code>this</code> partitioner/partition size, because even if <code>other</code> is huge, the resulting +RDD will be <= us. +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#take" data-isabs="false"> + <a id="take(Int):Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div></div> + </li><li visbl="pub" name="spark.RDD#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.RDD#toArray" data-isabs="false"> + <a id="toArray():Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p> + </li><li visbl="pub" name="spark.RDD#toDebugString" data-isabs="false"> + <a id="toDebugString:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toDebugString</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A description of this RDD and its recursive dependencies for debugging.</p> + </li><li visbl="pub" name="spark.RDD#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="">RDD</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#union" data-isabs="false"> + <a id="union(RDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#zip" data-isabs="false"> + <a id="zip[U](RDD[U])(ClassManifest[U]):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc.</p><div class="fullcomment"><div class="comment cmt"><p>Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc. Assumes that the two RDDs have the *same number of +partitions* and the *same number of elements in each partition* (e.g. one was made through +a map on the other). +</p></div></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="spark.RDD#mapPartitionsWithSplit" data-isabs="false"> + <a id="mapPartitionsWithSplit[U]((Int, Iterator[T]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version scala.this.deprecated.init$default$2) use mapPartitionsWithIndex">mapPartitionsWithSplit</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[T]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version scala.this.deprecated.init$default$2)</i> use mapPartitionsWithIndex</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="Logging.html">Logging</a></h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/RangeDependency.html b/site/docs/0.7.0/api/core/spark/RangeDependency.html new file mode 100644 index 000000000..c72d270da --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/RangeDependency.html @@ -0,0 +1,392 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.RangeDependency</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>RangeDependency</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">RangeDependency</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <a name="spark.NarrowDependency" class="extype" href="NarrowDependency.html">NarrowDependency</a>[T]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Represents a one-to-one dependency between ranges of partitions in the parent and child RDDs.</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.NarrowDependency" class="extype" href="NarrowDependency.html">NarrowDependency</a>[T], <a name="spark.Dependency" class="extype" href="Dependency.html">Dependency</a>[T], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.RangeDependency" class="in"><span>RangeDependency</span></li><li name="spark.NarrowDependency" class="in"><span>NarrowDependency</span></li><li name="spark.Dependency" class="in"><span>Dependency</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.RangeDependency#this" data-isabs="false"> + <a id="this:RangeDependency[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">RangeDependency</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span>, <span name="inStart">inStart: <span name="scala.Int" class="extype">Int</span></span>, <span name="outStart">outStart: <span name="scala.Int" class="extype">Int</span></span>, <span name="length">length: <span name="scala.Int" class="extype">Int</span></span>)</span> + </span> + </h4> + <p class="shortcomment cmt"></p><div class="fullcomment"><div class="comment cmt"></div><dl class="paramcmts block"><dt class="param">rdd</dt><dd class="cmt"><p>the parent RDD</p></dd><dt class="param">inStart</dt><dd class="cmt"><p>the start of the range in the parent RDD</p></dd><dt class="param">outStart</dt><dd class="cmt"><p>the start of the range in the child RDD</p></dd><dt class="param">length</dt><dd class="cmt"><p>the length of the range +</p></dd></dl></div> + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RangeDependency#getParents" data-isabs="false"> + <a id="getParents(Int):Seq[Int]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getParents</span><span class="params">(<span name="partitionId">partitionId: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: Seq[<span name="scala.Int" class="extype">Int</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the parent partitions for a child partition.</p><div class="fullcomment"><div class="comment cmt"><p>Get the parent partitions for a child partition.</p></div><dl class="paramcmts block"><dt class="param">partitionId</dt><dd class="cmt"><p>a partition of the child RDD</p></dd><dt>returns</dt><dd class="cmt"><p>the partitions of the parent RDD that the child partition depends upon +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RangeDependency" class="extype" href="">RangeDependency</a> → <a name="spark.NarrowDependency" class="extype" href="NarrowDependency.html">NarrowDependency</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.NarrowDependency" class="parent"> + <h3>Inherited from <a name="spark.NarrowDependency" class="extype" href="NarrowDependency.html">NarrowDependency</a>[T]</h3> + </div><div name="spark.Dependency" class="parent"> + <h3>Inherited from <a name="spark.Dependency" class="extype" href="Dependency.html">Dependency</a>[T]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/RangePartitioner.html b/site/docs/0.7.0/api/core/spark/RangePartitioner.html new file mode 100644 index 000000000..eaa6ff29f --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/RangePartitioner.html @@ -0,0 +1,402 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.RangePartitioner</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>RangePartitioner</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">RangePartitioner</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a> that partitions sortable records by range into roughly equal ranges. +Determines the ranges by sampling the RDD passed in. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a>, <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.RangePartitioner" class="in"><span>RangePartitioner</span></li><li name="spark.Partitioner" class="in"><span>Partitioner</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.RangePartitioner#this" data-isabs="false"> + <a id="this:RangePartitioner[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">RangePartitioner</span><span class="params">(<span name="partitions">partitions: <span name="scala.Int" class="extype">Int</span></span>, <span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span>, <span name="ascending">ascending: <span name="scala.Boolean" class="extype">Boolean</span> = <span class="symbol">true</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: (K) ⇒ Ordered[K]</span>, <span name="arg1">arg1: ClassManifest[K]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RangePartitioner#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="other">other: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RangePartitioner" class="extype" href="">RangePartitioner</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RangePartitioner#getPartition" data-isabs="false"> + <a id="getPartition(Any):Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPartition</span><span class="params">(<span name="key">key: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RangePartitioner" class="extype" href="">RangePartitioner</a> → <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RangePartitioner#numPartitions" data-isabs="false"> + <a id="numPartitions:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">numPartitions</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RangePartitioner" class="extype" href="">RangePartitioner</a> → <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.Partitioner" class="parent"> + <h3>Inherited from <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/SequenceFileRDDFunctions.html b/site/docs/0.7.0/api/core/spark/SequenceFileRDDFunctions.html new file mode 100644 index 000000000..b10af75f7 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/SequenceFileRDDFunctions.html @@ -0,0 +1,541 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.SequenceFileRDDFunctions</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>SequenceFileRDDFunctions</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">SequenceFileRDDFunctions</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends <a name="spark.Logging" class="extype" href="Logging.html">Logging</a> with <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Extra functions available on RDDs of (key, value) pairs to create a Hadoop SequenceFile, +through an implicit conversion. Note that this can't be part of PairRDDFunctions because +we need more implicit parameters to convert our keys and values to Writable.</p><p>Users should import <code>spark.SparkContext._</code> at the top of their program to use these functions. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <a name="spark.Logging" class="extype" href="Logging.html">Logging</a>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.SequenceFileRDDFunctions" class="in"><span>SequenceFileRDDFunctions</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.SequenceFileRDDFunctions#this" data-isabs="false"> + <a id="this:SequenceFileRDDFunctions[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">SequenceFileRDDFunctions</span><span class="params">(<span name="self">self: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: (K) ⇒ <span name="org.apache.hadoop.io.Writable" class="extype">Writable</span></span>, <span name="arg1">arg1: ClassManifest[K]</span>, <span name="arg2">arg2: (V) ⇒ <span name="org.apache.hadoop.io.Writable" class="extype">Writable</span></span>, <span name="arg3">arg3: ClassManifest[V]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.SequenceFileRDDFunctions#saveAsSequenceFile" data-isabs="false"> + <a id="saveAsSequenceFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsSequenceFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Output the RDD as a Hadoop SequenceFile using the Writable types we infer from the RDD's key +and value types.</p><div class="fullcomment"><div class="comment cmt"><p>Output the RDD as a Hadoop SequenceFile using the Writable types we infer from the RDD's key +and value types. If the key or value are Writable, then we use their classes directly; +otherwise we map primitive types such as Int and Double to IntWritable, DoubleWritable, etc, +byte arrays to BytesWritable, and Strings to Text. The <code>path</code> can be on any Hadoop-supported +file system. +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="Logging.html">Logging</a></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/SerializableWritable.html b/site/docs/0.7.0/api/core/spark/SerializableWritable.html new file mode 100644 index 000000000..a864c4be4 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/SerializableWritable.html @@ -0,0 +1,396 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.SerializableWritable</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>SerializableWritable</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">SerializableWritable</span><span class="tparams">[<span name="T">T <: <span name="org.apache.hadoop.io.Writable" class="extype">Writable</span></span>]</span><span class="result"> extends <span name="java.io.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.SerializableWritable" class="in"><span>SerializableWritable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.SerializableWritable#this" data-isabs="false"> + <a id="this:SerializableWritable[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">SerializableWritable</span><span class="params">(<span name="t">t: T</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.SerializableWritable#t" data-isabs="false"> + <a id="t:T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">t</span><span class="result">: T</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SerializableWritable#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.SerializableWritable" class="extype" href="">SerializableWritable</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.SerializableWritable#value" data-isabs="false"> + <a id="value:T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">value</span><span class="result">: T</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/ShuffleDependency.html b/site/docs/0.7.0/api/core/spark/ShuffleDependency.html new file mode 100644 index 000000000..043d8c8bb --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/ShuffleDependency.html @@ -0,0 +1,402 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.ShuffleDependency</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>ShuffleDependency</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">ShuffleDependency</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends <a name="spark.Dependency" class="extype" href="Dependency.html">Dependency</a>[(K, V)]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Represents a dependency on the output of a shuffle stage.</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.Dependency" class="extype" href="Dependency.html">Dependency</a>[(K, V)], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.ShuffleDependency" class="in"><span>ShuffleDependency</span></li><li name="spark.Dependency" class="in"><span>Dependency</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.ShuffleDependency#this" data-isabs="false"> + <a id="this:ShuffleDependency[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">ShuffleDependency</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span>, <span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span>)</span> + </span> + </h4> + <p class="shortcomment cmt"></p><div class="fullcomment"><div class="comment cmt"></div><dl class="paramcmts block"><dt class="param">rdd</dt><dd class="cmt"><p>the parent RDD</p></dd><dt class="param">partitioner</dt><dd class="cmt"><p>partitioner used to partition the shuffle output +</p></dd></dl></div> + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.ShuffleDependency#partitioner" data-isabs="false"> + <a id="partitioner:Partitioner"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitioner</span><span class="result">: <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a></span> + </span> + </h4> + <p class="shortcomment cmt">partitioner used to partition the shuffle output +</p> + </li><li visbl="pub" name="spark.ShuffleDependency#shuffleId" data-isabs="false"> + <a id="shuffleId:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">shuffleId</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.Dependency" class="parent"> + <h3>Inherited from <a name="spark.Dependency" class="extype" href="Dependency.html">Dependency</a>[(K, V)]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/SparkContext$$DoubleAccumulatorParam$.html b/site/docs/0.7.0/api/core/spark/SparkContext$$DoubleAccumulatorParam$.html new file mode 100644 index 000000000..1e4b63f72 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/SparkContext$$DoubleAccumulatorParam$.html @@ -0,0 +1,417 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.SparkContext.DoubleAccumulatorParam</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a>.<a name="spark.SparkContext" class="extype" href="SparkContext$.html">SparkContext</a></p> + <h1>DoubleAccumulatorParam</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">DoubleAccumulatorParam</span><span class="result"> extends <a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a>[<span name="scala.Double" class="extype">Double</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a>[<span name="scala.Double" class="extype">Double</span>], <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a>[<span name="scala.Double" class="extype">Double</span>, <span name="scala.Double" class="extype">Double</span>], <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.SparkContext.DoubleAccumulatorParam" class="in"><span>DoubleAccumulatorParam</span></li><li name="spark.AccumulatorParam" class="in"><span>AccumulatorParam</span></li><li name="spark.AccumulableParam" class="in"><span>AccumulableParam</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.AccumulatorParam#addAccumulator" data-isabs="false"> + <a id="addAccumulator(Double,Double):Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addAccumulator</span><span class="params">(<span name="t1">t1: <span name="scala.Double" class="extype">Double</span></span>, <span name="t2">t2: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Add additional data to the accumulator value.</p><div class="fullcomment"><div class="comment cmt"><p>Add additional data to the accumulator value. Is allowed to modify and return <code>r</code> +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt>returns</dt><dd class="cmt"><p>the new value of the accumulator +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext.DoubleAccumulatorParam#addInPlace" data-isabs="false"> + <a id="addInPlace(Double,Double):Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addInPlace</span><span class="params">(<span name="t1">t1: <span name="scala.Double" class="extype">Double</span></span>, <span name="t2">t2: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Merge two accumulated values together.</p><div class="fullcomment"><div class="comment cmt"><p>Merge two accumulated values together. Is allowed to modify and return the first value +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt>returns</dt><dd class="cmt"><p>both data sets merged together +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.SparkContext.DoubleAccumulatorParam" class="extype" href="">DoubleAccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="spark.SparkContext.DoubleAccumulatorParam#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext.DoubleAccumulatorParam#zero" data-isabs="false"> + <a id="zero(Double):Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zero</span><span class="params">(<span name="initialValue">initialValue: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the "zero" (identity) value for an accumulator type, given its initial value.</p><div class="fullcomment"><div class="comment cmt"><p>Return the "zero" (identity) value for an accumulator type, given its initial value. For +example, if R was a vector of N dimensions, this would return a vector of N zeroes. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.SparkContext.DoubleAccumulatorParam" class="extype" href="">DoubleAccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.AccumulatorParam" class="parent"> + <h3>Inherited from <a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a>[<span name="scala.Double" class="extype">Double</span>]</h3> + </div><div name="spark.AccumulableParam" class="parent"> + <h3>Inherited from <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a>[<span name="scala.Double" class="extype">Double</span>, <span name="scala.Double" class="extype">Double</span>]</h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/SparkContext$$FloatAccumulatorParam$.html b/site/docs/0.7.0/api/core/spark/SparkContext$$FloatAccumulatorParam$.html new file mode 100644 index 000000000..0999bd34d --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/SparkContext$$FloatAccumulatorParam$.html @@ -0,0 +1,417 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.SparkContext.FloatAccumulatorParam</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a>.<a name="spark.SparkContext" class="extype" href="SparkContext$.html">SparkContext</a></p> + <h1>FloatAccumulatorParam</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">FloatAccumulatorParam</span><span class="result"> extends <a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a>[<span name="scala.Float" class="extype">Float</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a>[<span name="scala.Float" class="extype">Float</span>], <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a>[<span name="scala.Float" class="extype">Float</span>, <span name="scala.Float" class="extype">Float</span>], <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.SparkContext.FloatAccumulatorParam" class="in"><span>FloatAccumulatorParam</span></li><li name="spark.AccumulatorParam" class="in"><span>AccumulatorParam</span></li><li name="spark.AccumulableParam" class="in"><span>AccumulableParam</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.AccumulatorParam#addAccumulator" data-isabs="false"> + <a id="addAccumulator(Float,Float):Float"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addAccumulator</span><span class="params">(<span name="t1">t1: <span name="scala.Float" class="extype">Float</span></span>, <span name="t2">t2: <span name="scala.Float" class="extype">Float</span></span>)</span><span class="result">: <span name="scala.Float" class="extype">Float</span></span> + </span> + </h4> + <p class="shortcomment cmt">Add additional data to the accumulator value.</p><div class="fullcomment"><div class="comment cmt"><p>Add additional data to the accumulator value. Is allowed to modify and return <code>r</code> +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt>returns</dt><dd class="cmt"><p>the new value of the accumulator +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext.FloatAccumulatorParam#addInPlace" data-isabs="false"> + <a id="addInPlace(Float,Float):Float"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addInPlace</span><span class="params">(<span name="t1">t1: <span name="scala.Float" class="extype">Float</span></span>, <span name="t2">t2: <span name="scala.Float" class="extype">Float</span></span>)</span><span class="result">: <span name="scala.Float" class="extype">Float</span></span> + </span> + </h4> + <p class="shortcomment cmt">Merge two accumulated values together.</p><div class="fullcomment"><div class="comment cmt"><p>Merge two accumulated values together. Is allowed to modify and return the first value +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt>returns</dt><dd class="cmt"><p>both data sets merged together +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.SparkContext.FloatAccumulatorParam" class="extype" href="">FloatAccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="spark.SparkContext.FloatAccumulatorParam#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext.FloatAccumulatorParam#zero" data-isabs="false"> + <a id="zero(Float):Float"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zero</span><span class="params">(<span name="initialValue">initialValue: <span name="scala.Float" class="extype">Float</span></span>)</span><span class="result">: <span name="scala.Float" class="extype">Float</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the "zero" (identity) value for an accumulator type, given its initial value.</p><div class="fullcomment"><div class="comment cmt"><p>Return the "zero" (identity) value for an accumulator type, given its initial value. For +example, if R was a vector of N dimensions, this would return a vector of N zeroes. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.SparkContext.FloatAccumulatorParam" class="extype" href="">FloatAccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.AccumulatorParam" class="parent"> + <h3>Inherited from <a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a>[<span name="scala.Float" class="extype">Float</span>]</h3> + </div><div name="spark.AccumulableParam" class="parent"> + <h3>Inherited from <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a>[<span name="scala.Float" class="extype">Float</span>, <span name="scala.Float" class="extype">Float</span>]</h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/SparkContext$$IntAccumulatorParam$.html b/site/docs/0.7.0/api/core/spark/SparkContext$$IntAccumulatorParam$.html new file mode 100644 index 000000000..a5c650fde --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/SparkContext$$IntAccumulatorParam$.html @@ -0,0 +1,417 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.SparkContext.IntAccumulatorParam</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a>.<a name="spark.SparkContext" class="extype" href="SparkContext$.html">SparkContext</a></p> + <h1>IntAccumulatorParam</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">IntAccumulatorParam</span><span class="result"> extends <a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a>[<span name="scala.Int" class="extype">Int</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a>[<span name="scala.Int" class="extype">Int</span>], <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a>[<span name="scala.Int" class="extype">Int</span>, <span name="scala.Int" class="extype">Int</span>], <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.SparkContext.IntAccumulatorParam" class="in"><span>IntAccumulatorParam</span></li><li name="spark.AccumulatorParam" class="in"><span>AccumulatorParam</span></li><li name="spark.AccumulableParam" class="in"><span>AccumulableParam</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.AccumulatorParam#addAccumulator" data-isabs="false"> + <a id="addAccumulator(Int,Int):Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addAccumulator</span><span class="params">(<span name="t1">t1: <span name="scala.Int" class="extype">Int</span></span>, <span name="t2">t2: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">Add additional data to the accumulator value.</p><div class="fullcomment"><div class="comment cmt"><p>Add additional data to the accumulator value. Is allowed to modify and return <code>r</code> +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt>returns</dt><dd class="cmt"><p>the new value of the accumulator +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext.IntAccumulatorParam#addInPlace" data-isabs="false"> + <a id="addInPlace(Int,Int):Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addInPlace</span><span class="params">(<span name="t1">t1: <span name="scala.Int" class="extype">Int</span></span>, <span name="t2">t2: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">Merge two accumulated values together.</p><div class="fullcomment"><div class="comment cmt"><p>Merge two accumulated values together. Is allowed to modify and return the first value +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt>returns</dt><dd class="cmt"><p>both data sets merged together +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.SparkContext.IntAccumulatorParam" class="extype" href="">IntAccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="spark.SparkContext.IntAccumulatorParam#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext.IntAccumulatorParam#zero" data-isabs="false"> + <a id="zero(Int):Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zero</span><span class="params">(<span name="initialValue">initialValue: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the "zero" (identity) value for an accumulator type, given its initial value.</p><div class="fullcomment"><div class="comment cmt"><p>Return the "zero" (identity) value for an accumulator type, given its initial value. For +example, if R was a vector of N dimensions, this would return a vector of N zeroes. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.SparkContext.IntAccumulatorParam" class="extype" href="">IntAccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.AccumulatorParam" class="parent"> + <h3>Inherited from <a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a>[<span name="scala.Int" class="extype">Int</span>]</h3> + </div><div name="spark.AccumulableParam" class="parent"> + <h3>Inherited from <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a>[<span name="scala.Int" class="extype">Int</span>, <span name="scala.Int" class="extype">Int</span>]</h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/SparkContext$$LongAccumulatorParam$.html b/site/docs/0.7.0/api/core/spark/SparkContext$$LongAccumulatorParam$.html new file mode 100644 index 000000000..5fe0fb71d --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/SparkContext$$LongAccumulatorParam$.html @@ -0,0 +1,417 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.SparkContext.LongAccumulatorParam</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a>.<a name="spark.SparkContext" class="extype" href="SparkContext$.html">SparkContext</a></p> + <h1>LongAccumulatorParam</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">LongAccumulatorParam</span><span class="result"> extends <a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a>[<span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a>[<span name="scala.Long" class="extype">Long</span>], <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a>[<span name="scala.Long" class="extype">Long</span>, <span name="scala.Long" class="extype">Long</span>], <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.SparkContext.LongAccumulatorParam" class="in"><span>LongAccumulatorParam</span></li><li name="spark.AccumulatorParam" class="in"><span>AccumulatorParam</span></li><li name="spark.AccumulableParam" class="in"><span>AccumulableParam</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.AccumulatorParam#addAccumulator" data-isabs="false"> + <a id="addAccumulator(Long,Long):Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addAccumulator</span><span class="params">(<span name="t1">t1: <span name="scala.Long" class="extype">Long</span></span>, <span name="t2">t2: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Add additional data to the accumulator value.</p><div class="fullcomment"><div class="comment cmt"><p>Add additional data to the accumulator value. Is allowed to modify and return <code>r</code> +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt>returns</dt><dd class="cmt"><p>the new value of the accumulator +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext.LongAccumulatorParam#addInPlace" data-isabs="false"> + <a id="addInPlace(Long,Long):Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addInPlace</span><span class="params">(<span name="t1">t1: <span name="scala.Long" class="extype">Long</span></span>, <span name="t2">t2: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Merge two accumulated values together.</p><div class="fullcomment"><div class="comment cmt"><p>Merge two accumulated values together. Is allowed to modify and return the first value +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt>returns</dt><dd class="cmt"><p>both data sets merged together +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.SparkContext.LongAccumulatorParam" class="extype" href="">LongAccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="spark.SparkContext.LongAccumulatorParam#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext.LongAccumulatorParam#zero" data-isabs="false"> + <a id="zero(Long):Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zero</span><span class="params">(<span name="initialValue">initialValue: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the "zero" (identity) value for an accumulator type, given its initial value.</p><div class="fullcomment"><div class="comment cmt"><p>Return the "zero" (identity) value for an accumulator type, given its initial value. For +example, if R was a vector of N dimensions, this would return a vector of N zeroes. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.SparkContext.LongAccumulatorParam" class="extype" href="">LongAccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.AccumulatorParam" class="parent"> + <h3>Inherited from <a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a>[<span name="scala.Long" class="extype">Long</span>]</h3> + </div><div name="spark.AccumulableParam" class="parent"> + <h3>Inherited from <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a>[<span name="scala.Long" class="extype">Long</span>, <span name="scala.Long" class="extype">Long</span>]</h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/SparkContext$.html b/site/docs/0.7.0/api/core/spark/SparkContext$.html new file mode 100644 index 000000000..9457b81fb --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/SparkContext$.html @@ -0,0 +1,671 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.SparkContext</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="SparkContext.html"><img src="../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1><a title="Go to companion" href="SparkContext.html">SparkContext</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">SparkContext</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>The SparkContext object contains a number of implicit conversions and parameters for use with +various Spark features. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent">AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.SparkContext" class="in"><span>SparkContext</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext.DoubleAccumulatorParam" data-isabs="false"> + <a id="DoubleAccumulatorParam:DoubleAccumulatorParam"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="SparkContext$$DoubleAccumulatorParam$.html"><span class="name">DoubleAccumulatorParam</span></a><span class="result"> extends AccumulatorParam[Double]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext.FloatAccumulatorParam" data-isabs="false"> + <a id="FloatAccumulatorParam:FloatAccumulatorParam"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="SparkContext$$FloatAccumulatorParam$.html"><span class="name">FloatAccumulatorParam</span></a><span class="result"> extends AccumulatorParam[Float]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext.IntAccumulatorParam" data-isabs="false"> + <a id="IntAccumulatorParam:IntAccumulatorParam"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="SparkContext$$IntAccumulatorParam$.html"><span class="name">IntAccumulatorParam</span></a><span class="result"> extends AccumulatorParam[Int]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext.LongAccumulatorParam" data-isabs="false"> + <a id="LongAccumulatorParam:LongAccumulatorParam"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="SparkContext$$LongAccumulatorParam$.html"><span class="name">LongAccumulatorParam</span></a><span class="result"> extends AccumulatorParam[Long]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#boolToBoolWritable" data-isabs="false"> + <a id="boolToBoolWritable(Boolean):BooleanWritable"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">boolToBoolWritable</span><span class="params">(<span name="b">b: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="org.apache.hadoop.io.BooleanWritable" class="extype">BooleanWritable</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext#booleanWritableConverter" data-isabs="false"> + <a id="booleanWritableConverter():WritableConverter[Boolean]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">booleanWritableConverter</span><span class="params">()</span><span class="result">: <span name="spark.WritableConverter" class="extype">WritableConverter</span>[<span name="scala.Boolean" class="extype">Boolean</span>]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext#bytesToBytesWritable" data-isabs="false"> + <a id="bytesToBytesWritable(Array[Byte]):BytesWritable"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">bytesToBytesWritable</span><span class="params">(<span name="aob">aob: <span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]</span>)</span><span class="result">: <span name="org.apache.hadoop.io.BytesWritable" class="extype">BytesWritable</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext#bytesWritableConverter" data-isabs="false"> + <a id="bytesWritableConverter():WritableConverter[Array[Byte]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">bytesWritableConverter</span><span class="params">()</span><span class="result">: <span name="spark.WritableConverter" class="extype">WritableConverter</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]]</span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#doubleRDDToDoubleRDDFunctions" data-isabs="false"> + <a id="doubleRDDToDoubleRDDFunctions(RDD[Double]):DoubleRDDFunctions"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">doubleRDDToDoubleRDDFunctions</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[<span name="scala.Double" class="extype">Double</span>]</span>)</span><span class="result">: <a name="spark.DoubleRDDFunctions" class="extype" href="DoubleRDDFunctions.html">DoubleRDDFunctions</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext#doubleToDoubleWritable" data-isabs="false"> + <a id="doubleToDoubleWritable(Double):DoubleWritable"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">doubleToDoubleWritable</span><span class="params">(<span name="d">d: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <span name="org.apache.hadoop.io.DoubleWritable" class="extype">DoubleWritable</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext#doubleWritableConverter" data-isabs="false"> + <a id="doubleWritableConverter():WritableConverter[Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">doubleWritableConverter</span><span class="params">()</span><span class="result">: <span name="spark.WritableConverter" class="extype">WritableConverter</span>[<span name="scala.Double" class="extype">Double</span>]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#floatToFloatWritable" data-isabs="false"> + <a id="floatToFloatWritable(Float):FloatWritable"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">floatToFloatWritable</span><span class="params">(<span name="f">f: <span name="scala.Float" class="extype">Float</span></span>)</span><span class="result">: <span name="org.apache.hadoop.io.FloatWritable" class="extype">FloatWritable</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext#floatWritableConverter" data-isabs="false"> + <a id="floatWritableConverter():WritableConverter[Float]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">floatWritableConverter</span><span class="params">()</span><span class="result">: <span name="spark.WritableConverter" class="extype">WritableConverter</span>[<span name="scala.Float" class="extype">Float</span>]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#intToIntWritable" data-isabs="false"> + <a id="intToIntWritable(Int):IntWritable"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">intToIntWritable</span><span class="params">(<span name="i">i: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="org.apache.hadoop.io.IntWritable" class="extype">IntWritable</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext#intWritableConverter" data-isabs="false"> + <a id="intWritableConverter():WritableConverter[Int]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">intWritableConverter</span><span class="params">()</span><span class="result">: <span name="spark.WritableConverter" class="extype">WritableConverter</span>[<span name="scala.Int" class="extype">Int</span>]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#jarOfClass" data-isabs="false"> + <a id="jarOfClass(Class[_]):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">jarOfClass</span><span class="params">(<span name="cls">cls: Class[_]</span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Find the JAR from which a given class was loaded, to make it easy for users to pass +their JARs to SparkContext +</p> + </li><li visbl="pub" name="spark.SparkContext#jarOfObject" data-isabs="false"> + <a id="jarOfObject(AnyRef):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">jarOfObject</span><span class="params">(<span name="obj">obj: AnyRef</span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Find the JAR that contains the class of a particular object</p> + </li><li visbl="pub" name="spark.SparkContext#longToLongWritable" data-isabs="false"> + <a id="longToLongWritable(Long):LongWritable"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">longToLongWritable</span><span class="params">(<span name="l">l: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="org.apache.hadoop.io.LongWritable" class="extype">LongWritable</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext#longWritableConverter" data-isabs="false"> + <a id="longWritableConverter():WritableConverter[Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">longWritableConverter</span><span class="params">()</span><span class="result">: <span name="spark.WritableConverter" class="extype">WritableConverter</span>[<span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#numericRDDToDoubleRDDFunctions" data-isabs="false"> + <a id="numericRDDToDoubleRDDFunctions[T](RDD[T])(Numeric[T]):DoubleRDDFunctions"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">numericRDDToDoubleRDDFunctions</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="num">num: Numeric[T]</span>)</span><span class="result">: <a name="spark.DoubleRDDFunctions" class="extype" href="DoubleRDDFunctions.html">DoubleRDDFunctions</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext#rddToOrderedRDDFunctions" data-isabs="false"> + <a id="rddToOrderedRDDFunctions[K, V](RDD[(K, V)])((K) ⇒ Ordered[K],ClassManifest[K],ClassManifest[V]):OrderedRDDFunctions[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">rddToOrderedRDDFunctions</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: (K) ⇒ Ordered[K]</span>, <span name="arg1">arg1: ClassManifest[K]</span>, <span name="arg2">arg2: ClassManifest[V]</span>)</span><span class="result">: <a name="spark.OrderedRDDFunctions" class="extype" href="OrderedRDDFunctions.html">OrderedRDDFunctions</a>[K, V]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext#rddToPairRDDFunctions" data-isabs="false"> + <a id="rddToPairRDDFunctions[K, V](RDD[(K, V)])(ClassManifest[K],ClassManifest[V]):PairRDDFunctions[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">rddToPairRDDFunctions</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>, <span name="arg1">arg1: ClassManifest[V]</span>)</span><span class="result">: <a name="spark.PairRDDFunctions" class="extype" href="PairRDDFunctions.html">PairRDDFunctions</a>[K, V]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext#rddToSequenceFileRDDFunctions" data-isabs="false"> + <a id="rddToSequenceFileRDDFunctions[K, V](RDD[(K, V)])((K) ⇒ Writable,ClassManifest[K],(V) ⇒ Writable,ClassManifest[V]):SequenceFileRDDFunctions[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">rddToSequenceFileRDDFunctions</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: (K) ⇒ <span name="org.apache.hadoop.io.Writable" class="extype">Writable</span></span>, <span name="arg1">arg1: ClassManifest[K]</span>, <span name="arg2">arg2: (V) ⇒ <span name="org.apache.hadoop.io.Writable" class="extype">Writable</span></span>, <span name="arg3">arg3: ClassManifest[V]</span>)</span><span class="result">: <a name="spark.SequenceFileRDDFunctions" class="extype" href="SequenceFileRDDFunctions.html">SequenceFileRDDFunctions</a>[K, V]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext#stringToText" data-isabs="false"> + <a id="stringToText(String):Text"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">stringToText</span><span class="params">(<span name="s">s: String</span>)</span><span class="result">: <span name="org.apache.hadoop.io.Text" class="extype">Text</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext#stringWritableConverter" data-isabs="false"> + <a id="stringWritableConverter():WritableConverter[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">stringWritableConverter</span><span class="params">()</span><span class="result">: <span name="spark.WritableConverter" class="extype">WritableConverter</span>[String]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#writableWritableConverter" data-isabs="false"> + <a id="writableWritableConverter[T<:Writable]():WritableConverter[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">writableWritableConverter</span><span class="tparams">[<span name="T">T <: <span name="org.apache.hadoop.io.Writable" class="extype">Writable</span></span>]</span><span class="params">()</span><span class="result">: <span name="spark.WritableConverter" class="extype">WritableConverter</span>[T]</span> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/SparkContext.html b/site/docs/0.7.0/api/core/spark/SparkContext.html new file mode 100644 index 000000000..d19e7fd1c --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/SparkContext.html @@ -0,0 +1,1159 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.SparkContext</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="SparkContext$.html"><img src="../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1><a title="Go to companion" href="SparkContext$.html">SparkContext</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">SparkContext</span><span class="result"> extends <a name="spark.Logging" class="extype" href="Logging.html">Logging</a></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Main entry point for Spark functionality. A SparkContext represents the connection to a Spark +cluster, and can be used to create RDDs, accumulators and broadcast variables on that cluster. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.Logging" class="extype" href="Logging.html">Logging</a>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.SparkContext" class="in"><span>SparkContext</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.SparkContext#this" data-isabs="false"> + <a id="this:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">SparkContext</span><span class="params">(<span name="master">master: String</span>, <span name="appName">appName: String</span>, <span name="sparkHome">sparkHome: String = <span class="symbol">null</span></span>, <span name="jars">jars: Seq[String] = <span class="symbol">immutable.this.Nil</span></span>, <span name="environment">environment: <span name="scala.collection.Map" class="extype">Map</span>[String, String] = <span name="scala.collection.Map.apply[String, Nothing]()" class="defval">...</span></span>)</span> + </span> + </h4> + <p class="shortcomment cmt"></p><div class="fullcomment"><div class="comment cmt"></div><dl class="paramcmts block"><dt class="param">master</dt><dd class="cmt"><p>Cluster URL to connect to (e.g. mesos://host:port, spark://host:port, local[4]).</p></dd><dt class="param">appName</dt><dd class="cmt"><p>A name for your application, to display on the cluster web UI.</p></dd><dt class="param">sparkHome</dt><dd class="cmt"><p>Location where Spark is installed on cluster nodes.</p></dd><dt class="param">jars</dt><dd class="cmt"><p>Collection of JARs to send to the cluster. These can be paths on the local file + system or HDFS, HTTP, HTTPS, or FTP URLs.</p></dd><dt class="param">environment</dt><dd class="cmt"><p>Environment variables to set on worker nodes. +</p></dd></dl></div> + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#accumulable" data-isabs="false"> + <a id="accumulable[T, R](T)(AccumulableParam[T, R]):Accumulable[T, R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">accumulable</span><span class="tparams">[<span name="T">T</span>, <span name="R">R</span>]</span><span class="params">(<span name="initialValue">initialValue: T</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="param">param: <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a>[T, R]</span>)</span><span class="result">: <a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a>[T, R]</span> + </span> + </h4> + <p class="shortcomment cmt">Create an <a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a> shared variable, to which tasks can add values with <code>+=</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Create an <a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a> shared variable, to which tasks can add values with <code>+=</code>. +Only the driver can access the accumuable's <code>value</code>.</p></div><dl class="paramcmts block"><dt class="tparam">T</dt><dd class="cmt"><p>accumulator type</p></dd><dt class="tparam">R</dt><dd class="cmt"><p>type that can be added to the accumulator +</p></dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#accumulableCollection" data-isabs="false"> + <a id="accumulableCollection[R, T](R)((R) ⇒ Growable[T] with TraversableOnce[T] with Serializable):Accumulable[R, T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">accumulableCollection</span><span class="tparams">[<span name="R">R</span>, <span name="T">T</span>]</span><span class="params">(<span name="initialValue">initialValue: R</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: (R) ⇒ <span name="scala.collection.generic.Growable" class="extype">Growable</span>[T] with TraversableOnce[T] with <span name="java.io.Serializable" class="extype">Serializable</span></span>)</span><span class="result">: <a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a>[R, T]</span> + </span> + </h4> + <p class="shortcomment cmt">Create an accumulator from a "mutable collection" type.</p><div class="fullcomment"><div class="comment cmt"><p>Create an accumulator from a "mutable collection" type.</p><p>Growable and TraversableOnce are the standard APIs that guarantee += and ++=, implemented by +standard mutable collections. So you can use this with mutable Map, Set, etc. +</p></div></div> + </li><li visbl="pub" name="spark.SparkContext#accumulator" data-isabs="false"> + <a id="accumulator[T](T)(AccumulatorParam[T]):Accumulator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">accumulator</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="initialValue">initialValue: T</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="param">param: <a name="spark.AccumulatorParam" class="extype" href="AccumulatorParam.html">AccumulatorParam</a>[T]</span>)</span><span class="result">: <a name="spark.Accumulator" class="extype" href="Accumulator.html">Accumulator</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Create an <a name="spark.Accumulator" class="extype" href="Accumulator.html">Accumulator</a> variable of a given type, which tasks can "add" values +to using the <code>+=</code> method.</p><div class="fullcomment"><div class="comment cmt"><p>Create an <a name="spark.Accumulator" class="extype" href="Accumulator.html">Accumulator</a> variable of a given type, which tasks can "add" values +to using the <code>+=</code> method. Only the driver can access the accumulator's <code>value</code>. +</p></div></div> + </li><li visbl="pub" name="spark.SparkContext#addFile" data-isabs="false"> + <a id="addFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Add a file to be downloaded with this Spark job on every node.</p><div class="fullcomment"><div class="comment cmt"><p>Add a file to be downloaded with this Spark job on every node. +The <code>path</code> passed can be either a local file, a file in HDFS (or other Hadoop-supported +filesystems), or an HTTP, HTTPS or FTP URI. To access the file in Spark jobs, +use <code>SparkFiles.get(path)</code> to find its download location. +</p></div></div> + </li><li visbl="pub" name="spark.SparkContext#addJar" data-isabs="false"> + <a id="addJar(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addJar</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Adds a JAR dependency for all tasks to be executed on this SparkContext in the future.</p><div class="fullcomment"><div class="comment cmt"><p>Adds a JAR dependency for all tasks to be executed on this SparkContext in the future. +The <code>path</code> passed can be either a local file, a file in HDFS (or other Hadoop-supported +filesystems), or an HTTP, HTTPS or FTP URI. +</p></div></div> + </li><li visbl="pub" name="spark.SparkContext#appName" data-isabs="false"> + <a id="appName:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">appName</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A name for your application, to display on the cluster web UI.</p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#broadcast" data-isabs="false"> + <a id="broadcast[T](T):Broadcast[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">broadcast</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="value">value: T</span>)</span><span class="result">: <a name="spark.broadcast.Broadcast" class="extype" href="broadcast/Broadcast.html">Broadcast</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Broadcast a read-only variable to the cluster, returning a <a name="spark.broadcast.Broadcast" class="extype" href="broadcast/Broadcast.html">Broadcast</a> object for +reading it in distributed functions.</p><div class="fullcomment"><div class="comment cmt"><p>Broadcast a read-only variable to the cluster, returning a <a name="spark.broadcast.Broadcast" class="extype" href="broadcast/Broadcast.html">Broadcast</a> object for +reading it in distributed functions. The variable will be sent to each cluster only once. +</p></div></div> + </li><li visbl="prt" name="spark.SparkContext#checkpointFile" data-isabs="false"> + <a id="checkpointFile[T](String)(ClassManifest[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpointFile</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="path">path: String</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="spark" class="extype" href="package.html">spark</a>] </dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#clearFiles" data-isabs="false"> + <a id="clearFiles():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearFiles</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Clear the job's list of files added by <code>addFile</code> so that they do not get downloaded to +any new nodes.</p> + </li><li visbl="pub" name="spark.SparkContext#clearJars" data-isabs="false"> + <a id="clearJars():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearJars</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Clear the job's list of JARs added by <code>addJar</code> so that they do not get downloaded to +any new nodes.</p> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#defaultMinSplits" data-isabs="false"> + <a id="defaultMinSplits:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">defaultMinSplits</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">Default min number of partitions for Hadoop RDDs when not given by user</p> + </li><li visbl="pub" name="spark.SparkContext#defaultParallelism" data-isabs="false"> + <a id="defaultParallelism:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">defaultParallelism</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">Default level of parallelism to use when not given by user (e.</p><div class="fullcomment"><div class="comment cmt"><p>Default level of parallelism to use when not given by user (e.g. parallelize and makeRDD).</p></div></div> + </li><li visbl="pub" name="spark.SparkContext#environment" data-isabs="false"> + <a id="environment:Map[String, String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">environment</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span> + </span> + </h4> + <p class="shortcomment cmt">Environment variables to set on worker nodes.</p> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#getExecutorMemoryStatus" data-isabs="false"> + <a id="getExecutorMemoryStatus:Map[String, (Long, Long)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getExecutorMemoryStatus</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[String, (<span name="scala.Long" class="extype">Long</span>, <span name="scala.Long" class="extype">Long</span>)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a map from the slave to the max memory available for caching and the remaining +memory available for caching.</p> + </li><li visbl="pub" name="spark.SparkContext#getExecutorStorageStatus" data-isabs="false"> + <a id="getExecutorStorageStatus:Array[StorageStatus]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getExecutorStorageStatus</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return information about blocks stored in all of the slaves +</p> + </li><li visbl="pub" name="spark.SparkContext#getRDDStorageInfo" data-isabs="false"> + <a id="getRDDStorageInfo:Array[RDDInfo]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getRDDStorageInfo</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.storage.RDDInfo" class="extype" href="storage/RDDInfo.html">RDDInfo</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return information about what RDDs are cached, if they are in mem or on disk, how much space +they take, etc.</p> + </li><li visbl="pub" name="spark.SparkContext#hadoopConfiguration" data-isabs="false"> + <a id="hadoopConfiguration:Configuration"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">hadoopConfiguration</span><span class="result">: <span name="org.apache.hadoop.conf.Configuration" class="extype">Configuration</span></span> + </span> + </h4> + <p class="shortcomment cmt">A default Hadoop Configuration for the Hadoop code (e.</p><div class="fullcomment"><div class="comment cmt"><p>A default Hadoop Configuration for the Hadoop code (e.g. file systems) that we reuse.</p></div></div> + </li><li visbl="pub" name="spark.SparkContext#hadoopFile" data-isabs="false"> + <a id="hadoopFile[K, V, F<:InputFormat[K, V]](String)(ClassManifest[K],ClassManifest[V],ClassManifest[F]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hadoopFile</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>, <span name="F">F <: <span name="org.apache.hadoop.mapred.InputFormat" class="extype">InputFormat</span>[K, V]</span>]</span><span class="params">(<span name="path">path: String</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="km">km: ClassManifest[K]</span>, <span name="vm">vm: ClassManifest[V]</span>, <span name="fm">fm: ClassManifest[F]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Smarter version of hadoopFile() that uses class manifests to figure out the classes of keys, +values and the InputFormat so that users don't need to pass them directly.</p><div class="fullcomment"><div class="comment cmt"><p>Smarter version of hadoopFile() that uses class manifests to figure out the classes of keys, +values and the InputFormat so that users don't need to pass them directly. Instead, callers +can just write, for example,</p><pre> +<span class="kw">val</span> file = sparkContext.hadoopFile[LongWritable, Text, TextInputFormat](path) +</pre></div></div> + </li><li visbl="pub" name="spark.SparkContext#hadoopFile" data-isabs="false"> + <a id="hadoopFile[K, V, F<:InputFormat[K, V]](String,Int)(ClassManifest[K],ClassManifest[V],ClassManifest[F]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hadoopFile</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>, <span name="F">F <: <span name="org.apache.hadoop.mapred.InputFormat" class="extype">InputFormat</span>[K, V]</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="minSplits">minSplits: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="km">km: ClassManifest[K]</span>, <span name="vm">vm: ClassManifest[V]</span>, <span name="fm">fm: ClassManifest[F]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Smarter version of hadoopFile() that uses class manifests to figure out the classes of keys, +values and the InputFormat so that users don't need to pass them directly.</p><div class="fullcomment"><div class="comment cmt"><p>Smarter version of hadoopFile() that uses class manifests to figure out the classes of keys, +values and the InputFormat so that users don't need to pass them directly. Instead, callers +can just write, for example,</p><pre> +<span class="kw">val</span> file = sparkContext.hadoopFile[LongWritable, Text, TextInputFormat](path, minSplits) +</pre></div></div> + </li><li visbl="pub" name="spark.SparkContext#hadoopFile" data-isabs="false"> + <a id="hadoopFile[K, V](String,Class[_ <: org.apache.hadoop.mapred.InputFormat[K,V]],Class[K],Class[V],Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hadoopFile</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="inputFormatClass">inputFormatClass: Class[_ <: org.apache.hadoop.mapred.InputFormat[K,V]]</span>, <span name="keyClass">keyClass: Class[K]</span>, <span name="valueClass">valueClass: Class[V]</span>, <span name="minSplits">minSplits: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Get an RDD for a Hadoop file with an arbitrary InputFormat</p> + </li><li visbl="pub" name="spark.SparkContext#hadoopRDD" data-isabs="false"> + <a id="hadoopRDD[K, V](JobConf,Class[_ <: org.apache.hadoop.mapred.InputFormat[K,V]],Class[K],Class[V],Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hadoopRDD</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="conf">conf: <span name="org.apache.hadoop.mapred.JobConf" class="extype">JobConf</span></span>, <span name="inputFormatClass">inputFormatClass: Class[_ <: org.apache.hadoop.mapred.InputFormat[K,V]]</span>, <span name="keyClass">keyClass: Class[K]</span>, <span name="valueClass">valueClass: Class[V]</span>, <span name="minSplits">minSplits: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Get an RDD for a Hadoop-readable dataset from a Hadoop JobConf giving its InputFormat and any +other necessary info (e.</p><div class="fullcomment"><div class="comment cmt"><p>Get an RDD for a Hadoop-readable dataset from a Hadoop JobConf giving its InputFormat and any +other necessary info (e.g. file name for a filesystem-based dataset, table name for HyperTable, +etc). +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#jars" data-isabs="false"> + <a id="jars:Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">jars</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Collection of JARs to send to the cluster.</p><div class="fullcomment"><div class="comment cmt"><p>Collection of JARs to send to the cluster. These can be paths on the local file + system or HDFS, HTTP, HTTPS, or FTP URLs.</p></div></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#makeRDD" data-isabs="false"> + <a id="makeRDD[T](Seq[(T, Seq[String])])(ClassManifest[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">makeRDD</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="seq">seq: Seq[(T, Seq[String])]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Distribute a local Scala collection to form an RDD, with one or more +location preferences (hostnames of Spark nodes) for each object.</p><div class="fullcomment"><div class="comment cmt"><p>Distribute a local Scala collection to form an RDD, with one or more +location preferences (hostnames of Spark nodes) for each object. +Create a new partition for each collection item.</p></div></div> + </li><li visbl="pub" name="spark.SparkContext#makeRDD" data-isabs="false"> + <a id="makeRDD[T](Seq[T],Int)(ClassManifest[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">makeRDD</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="seq">seq: Seq[T]</span>, <span name="numSlices">numSlices: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Distribute a local Scala collection to form an RDD.</p> + </li><li visbl="pub" name="spark.SparkContext#master" data-isabs="false"> + <a id="master:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">master</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">Cluster URL to connect to (e.</p><div class="fullcomment"><div class="comment cmt"><p>Cluster URL to connect to (e.g. mesos://host:port, spark://host:port, local[4]).</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#newAPIHadoopFile" data-isabs="false"> + <a id="newAPIHadoopFile[K, V, F<:InputFormat[K, V]](String,Class[F],Class[K],Class[V],Configuration):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">newAPIHadoopFile</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>, <span name="F">F <: <span name="org.apache.hadoop.mapreduce.InputFormat" class="extype">InputFormat</span>[K, V]</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="fClass">fClass: Class[F]</span>, <span name="kClass">kClass: Class[K]</span>, <span name="vClass">vClass: Class[V]</span>, <span name="conf">conf: <span name="org.apache.hadoop.conf.Configuration" class="extype">Configuration</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Get an RDD for a given Hadoop file with an arbitrary new API InputFormat +and extra configuration options to pass to the input format.</p> + </li><li visbl="pub" name="spark.SparkContext#newAPIHadoopFile" data-isabs="false"> + <a id="newAPIHadoopFile[K, V, F<:InputFormat[K, V]](String)(ClassManifest[K],ClassManifest[V],ClassManifest[F]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">newAPIHadoopFile</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>, <span name="F">F <: <span name="org.apache.hadoop.mapreduce.InputFormat" class="extype">InputFormat</span>[K, V]</span>]</span><span class="params">(<span name="path">path: String</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="km">km: ClassManifest[K]</span>, <span name="vm">vm: ClassManifest[V]</span>, <span name="fm">fm: ClassManifest[F]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Get an RDD for a Hadoop file with an arbitrary new API InputFormat.</p> + </li><li visbl="pub" name="spark.SparkContext#newAPIHadoopRDD" data-isabs="false"> + <a id="newAPIHadoopRDD[K, V, F<:InputFormat[K, V]](Configuration,Class[F],Class[K],Class[V]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">newAPIHadoopRDD</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>, <span name="F">F <: <span name="org.apache.hadoop.mapreduce.InputFormat" class="extype">InputFormat</span>[K, V]</span>]</span><span class="params">(<span name="conf">conf: <span name="org.apache.hadoop.conf.Configuration" class="extype">Configuration</span></span>, <span name="fClass">fClass: Class[F]</span>, <span name="kClass">kClass: Class[K]</span>, <span name="vClass">vClass: Class[V]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Get an RDD for a given Hadoop file with an arbitrary new API InputFormat +and extra configuration options to pass to the input format.</p> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#objectFile" data-isabs="false"> + <a id="objectFile[T](String,Int)(ClassManifest[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">objectFile</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="minSplits">minSplits: <span name="scala.Int" class="extype">Int</span> = <span class="symbol"><span class="name"><a href="#defaultMinSplits:Int">defaultMinSplits</a></span></span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Load an RDD saved as a SequenceFile containing serialized objects, with NullWritable keys and +BytesWritable values that contain a serialized partition.</p><div class="fullcomment"><div class="comment cmt"><p>Load an RDD saved as a SequenceFile containing serialized objects, with NullWritable keys and +BytesWritable values that contain a serialized partition. This is still an experimental storage +format and may not be supported exactly as is in future Spark releases. It will also be pretty +slow if you use the default serializer (Java serialization), though the nice thing about it is +that there's very little effort required to save arbitrary objects. +</p></div></div> + </li><li visbl="pub" name="spark.SparkContext#parallelize" data-isabs="false"> + <a id="parallelize[T](Seq[T],Int)(ClassManifest[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">parallelize</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="seq">seq: Seq[T]</span>, <span name="numSlices">numSlices: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Distribute a local Scala collection to form an RDD.</p> + </li><li visbl="pub" name="spark.SparkContext#runApproximateJob" data-isabs="false"> + <a id="runApproximateJob[T, U, R](RDD[T],(TaskContext, Iterator[T]) ⇒ U,ApproximateEvaluator[U, R],Long):PartialResult[R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">runApproximateJob</span><span class="tparams">[<span name="T">T</span>, <span name="U">U</span>, <span name="R">R</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span>, <span name="func">func: (<a name="spark.TaskContext" class="extype" href="TaskContext.html">TaskContext</a>, Iterator[T]) ⇒ U</span>, <span name="evaluator">evaluator: <span name="spark.partial.ApproximateEvaluator" class="extype">ApproximateEvaluator</span>[U, R]</span>, <span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="partial/PartialResult.html">PartialResult</a>[R]</span> + </span> + </h4> + <p class="shortcomment cmt">Run a job that can return approximate results.</p> + </li><li visbl="pub" name="spark.SparkContext#runJob" data-isabs="false"> + <a id="runJob[T, U](RDD[T],(Iterator[T]) ⇒ U,(Int, U) ⇒ Unit)(ClassManifest[U]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">runJob</span><span class="tparams">[<span name="T">T</span>, <span name="U">U</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span>, <span name="processPartition">processPartition: (Iterator[T]) ⇒ U</span>, <span name="resultHandler">resultHandler: (<span name="scala.Int" class="extype">Int</span>, U) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Run a job on all partitions in an RDD and pass the results to a handler function.</p> + </li><li visbl="pub" name="spark.SparkContext#runJob" data-isabs="false"> + <a id="runJob[T, U](RDD[T],(TaskContext, Iterator[T]) ⇒ U,(Int, U) ⇒ Unit)(ClassManifest[U]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">runJob</span><span class="tparams">[<span name="T">T</span>, <span name="U">U</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span>, <span name="processPartition">processPartition: (<a name="spark.TaskContext" class="extype" href="TaskContext.html">TaskContext</a>, Iterator[T]) ⇒ U</span>, <span name="resultHandler">resultHandler: (<span name="scala.Int" class="extype">Int</span>, U) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Run a job on all partitions in an RDD and pass the results to a handler function.</p> + </li><li visbl="pub" name="spark.SparkContext#runJob" data-isabs="false"> + <a id="runJob[T, U](RDD[T],(Iterator[T]) ⇒ U)(ClassManifest[U]):Array[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">runJob</span><span class="tparams">[<span name="T">T</span>, <span name="U">U</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span>, <span name="func">func: (Iterator[T]) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Run a job on all partitions in an RDD and return the results in an array.</p> + </li><li visbl="pub" name="spark.SparkContext#runJob" data-isabs="false"> + <a id="runJob[T, U](RDD[T],(TaskContext, Iterator[T]) ⇒ U)(ClassManifest[U]):Array[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">runJob</span><span class="tparams">[<span name="T">T</span>, <span name="U">U</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span>, <span name="func">func: (<a name="spark.TaskContext" class="extype" href="TaskContext.html">TaskContext</a>, Iterator[T]) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Run a job on all partitions in an RDD and return the results in an array.</p> + </li><li visbl="pub" name="spark.SparkContext#runJob" data-isabs="false"> + <a id="runJob[T, U](RDD[T],(Iterator[T]) ⇒ U,Seq[Int],Boolean)(ClassManifest[U]):Array[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">runJob</span><span class="tparams">[<span name="T">T</span>, <span name="U">U</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span>, <span name="func">func: (Iterator[T]) ⇒ U</span>, <span name="partitions">partitions: Seq[<span name="scala.Int" class="extype">Int</span>]</span>, <span name="allowLocal">allowLocal: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Run a job on a given set of partitions of an RDD, but take a function of type +<code>Iterator[T] => U</code> instead of <code>(TaskContext, Iterator[T]) => U</code>.</p> + </li><li visbl="pub" name="spark.SparkContext#runJob" data-isabs="false"> + <a id="runJob[T, U](RDD[T],(TaskContext, Iterator[T]) ⇒ U,Seq[Int],Boolean)(ClassManifest[U]):Array[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">runJob</span><span class="tparams">[<span name="T">T</span>, <span name="U">U</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span>, <span name="func">func: (<a name="spark.TaskContext" class="extype" href="TaskContext.html">TaskContext</a>, Iterator[T]) ⇒ U</span>, <span name="partitions">partitions: Seq[<span name="scala.Int" class="extype">Int</span>]</span>, <span name="allowLocal">allowLocal: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Run a function on a given set of partitions in an RDD and return the results as an array.</p><div class="fullcomment"><div class="comment cmt"><p>Run a function on a given set of partitions in an RDD and return the results as an array. The +allowLocal flag specifies whether the scheduler can run the computation on the driver rather +than shipping it out to the cluster, for short actions like first(). +</p></div></div> + </li><li visbl="pub" name="spark.SparkContext#runJob" data-isabs="false"> + <a id="runJob[T, U](RDD[T],(TaskContext, Iterator[T]) ⇒ U,Seq[Int],Boolean,(Int, U) ⇒ Unit)(ClassManifest[U]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">runJob</span><span class="tparams">[<span name="T">T</span>, <span name="U">U</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span>, <span name="func">func: (<a name="spark.TaskContext" class="extype" href="TaskContext.html">TaskContext</a>, Iterator[T]) ⇒ U</span>, <span name="partitions">partitions: Seq[<span name="scala.Int" class="extype">Int</span>]</span>, <span name="allowLocal">allowLocal: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="resultHandler">resultHandler: (<span name="scala.Int" class="extype">Int</span>, U) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Run a function on a given set of partitions in an RDD and pass the results to the given +handler function.</p><div class="fullcomment"><div class="comment cmt"><p>Run a function on a given set of partitions in an RDD and pass the results to the given +handler function. This is the main entry point for all actions in Spark. The allowLocal +flag specifies whether the scheduler can run the computation on the driver rather than +shipping it out to the cluster, for short actions like first(). +</p></div></div> + </li><li visbl="pub" name="spark.SparkContext#sequenceFile" data-isabs="false"> + <a id="sequenceFile[K, V](String,Int)(ClassManifest[K],ClassManifest[V],() ⇒ WritableConverter[K],() ⇒ WritableConverter[V]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sequenceFile</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="minSplits">minSplits: <span name="scala.Int" class="extype">Int</span> = <span class="symbol"><span class="name"><a href="#defaultMinSplits:Int">defaultMinSplits</a></span></span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="km">km: ClassManifest[K]</span>, <span name="vm">vm: ClassManifest[V]</span>, <span name="kcf">kcf: () ⇒ <span name="spark.WritableConverter" class="extype">WritableConverter</span>[K]</span>, <span name="vcf">vcf: () ⇒ <span name="spark.WritableConverter" class="extype">WritableConverter</span>[V]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Version of sequenceFile() for types implicitly convertible to Writables through a +WritableConverter.</p><div class="fullcomment"><div class="comment cmt"><p>Version of sequenceFile() for types implicitly convertible to Writables through a +WritableConverter. For example, to access a SequenceFile where the keys are Text and the +values are IntWritable, you could simply write</p><pre> +sparkContext.sequenceFile[<span class="std">String</span>, <span class="std">Int</span>](path, ...) +</pre><p>WritableConverters are provided in a somewhat strange way (by an implicit function) to support +both subclasses of Writable and types for which we define a converter (e.g. Int to +IntWritable). The most natural thing would've been to have implicit objects for the +converters, but then we couldn't have an object for every subclass of Writable (you can't +have a parameterized singleton object). We use functions instead to create a new converter +for the appropriate type. In addition, we pass the converter a ClassManifest of its type to +allow it to figure out the Writable class to use in the subclass case. +</p></div></div> + </li><li visbl="pub" name="spark.SparkContext#sequenceFile" data-isabs="false"> + <a id="sequenceFile[K, V](String,Class[K],Class[V]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sequenceFile</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="keyClass">keyClass: Class[K]</span>, <span name="valueClass">valueClass: Class[V]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Get an RDD for a Hadoop SequenceFile with given key and value types.</p> + </li><li visbl="pub" name="spark.SparkContext#sequenceFile" data-isabs="false"> + <a id="sequenceFile[K, V](String,Class[K],Class[V],Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sequenceFile</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="keyClass">keyClass: Class[K]</span>, <span name="valueClass">valueClass: Class[V]</span>, <span name="minSplits">minSplits: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Get an RDD for a Hadoop SequenceFile with given key and value types.</p> + </li><li visbl="pub" name="spark.SparkContext#setCheckpointDir" data-isabs="false"> + <a id="setCheckpointDir(String,Boolean):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setCheckpointDir</span><span class="params">(<span name="dir">dir: String</span>, <span name="useExisting">useExisting: <span name="scala.Boolean" class="extype">Boolean</span> = <span class="symbol">false</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Set the directory under which RDDs are going to be checkpointed.</p><div class="fullcomment"><div class="comment cmt"><p>Set the directory under which RDDs are going to be checkpointed. The directory must +be a HDFS path if running on a cluster. If the directory does not exist, it will +be created. If the directory exists and useExisting is set to true, then the +exisiting directory will be used. Otherwise an exception will be thrown to +prevent accidental overriding of checkpoint files in the existing directory. +</p></div></div> + </li><li visbl="pub" name="spark.SparkContext#sparkHome" data-isabs="false"> + <a id="sparkHome:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">sparkHome</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">Location where Spark is installed on cluster nodes.</p> + </li><li visbl="pub" name="spark.SparkContext#stop" data-isabs="false"> + <a id="stop():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">stop</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Shut down the SparkContext.</p> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#textFile" data-isabs="false"> + <a id="textFile(String,Int):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">textFile</span><span class="params">(<span name="path">path: String</span>, <span name="minSplits">minSplits: <span name="scala.Int" class="extype">Int</span> = <span class="symbol"><span class="name"><a href="#defaultMinSplits:Int">defaultMinSplits</a></span></span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Read a text file from HDFS, a local file system (available on all nodes), or any +Hadoop-supported file system URI, and return it as an RDD of Strings.</p> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.SparkContext#union" data-isabs="false"> + <a id="union[T](RDD[T],RDD[T]*)(ClassManifest[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="first">first: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span>, <span name="rest">rest: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]*</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Build the union of a list of RDDs passed as variable-length arguments.</p> + </li><li visbl="pub" name="spark.SparkContext#union" data-isabs="false"> + <a id="union[T](Seq[RDD[T]])(ClassManifest[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="rdds">rdds: Seq[<a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Build the union of a list of RDDs.</p> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="Logging.html">Logging</a></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/SparkEnv$.html b/site/docs/0.7.0/api/core/spark/SparkEnv$.html new file mode 100644 index 000000000..3b844561c --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/SparkEnv$.html @@ -0,0 +1,537 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.SparkEnv</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="SparkEnv.html"><img src="../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1><a title="Go to companion" href="SparkEnv.html">SparkEnv</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">SparkEnv</span><span class="result"> extends <a name="spark.Logging" class="extype" href="Logging.html">Logging</a></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.Logging" class="extype" href="Logging.html">Logging</a>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.SparkEnv" class="in"><span>SparkEnv</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.SparkEnv#createFromSystemProperties" data-isabs="false"> + <a id="createFromSystemProperties(String,String,Int,Boolean,Boolean):SparkEnv"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">createFromSystemProperties</span><span class="params">(<span name="executorId">executorId: String</span>, <span name="hostname">hostname: String</span>, <span name="port">port: <span name="scala.Int" class="extype">Int</span></span>, <span name="isDriver">isDriver: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="isLocal">isLocal: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.SparkEnv" class="extype" href="SparkEnv.html">SparkEnv</a></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.SparkEnv#get" data-isabs="false"> + <a id="get:SparkEnv"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">get</span><span class="result">: <a name="spark.SparkEnv" class="extype" href="SparkEnv.html">SparkEnv</a></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.SparkEnv#set" data-isabs="false"> + <a id="set(SparkEnv):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">set</span><span class="params">(<span name="e">e: <a name="spark.SparkEnv" class="extype" href="SparkEnv.html">SparkEnv</a></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="Logging.html">Logging</a></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/SparkEnv.html b/site/docs/0.7.0/api/core/spark/SparkEnv.html new file mode 100644 index 000000000..aa65f955b --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/SparkEnv.html @@ -0,0 +1,531 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.SparkEnv</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="SparkEnv$.html"><img src="../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1><a title="Go to companion" href="SparkEnv$.html">SparkEnv</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">SparkEnv</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Holds all the runtime environment objects for a running Spark instance (either master or worker), +including the serializer, Akka actor system, block manager, map output tracker, etc. Currently +Spark code finds the SparkEnv through a thread-local variable, so each thread that accesses these +objects needs to have the right SparkEnv set. You can get the current environment with +SparkEnv.get (e.g. after creating a SparkContext) and set it with SparkEnv.set. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent">AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.SparkEnv" class="in"><span>SparkEnv</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.SparkEnv#this" data-isabs="false"> + <a id="this:SparkEnv"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">SparkEnv</span><span class="params">(<span name="executorId">executorId: String</span>, <span name="actorSystem">actorSystem: <span name="akka.actor.ActorSystem" class="extype">ActorSystem</span></span>, <span name="serializer">serializer: <a name="spark.serializer.Serializer" class="extype" href="serializer/Serializer.html">Serializer</a></span>, <span name="closureSerializer">closureSerializer: <a name="spark.serializer.Serializer" class="extype" href="serializer/Serializer.html">Serializer</a></span>, <span name="cacheManager">cacheManager: <span name="spark.CacheManager" class="extype">CacheManager</span></span>, <span name="mapOutputTracker">mapOutputTracker: <span name="spark.MapOutputTracker" class="extype">MapOutputTracker</span></span>, <span name="shuffleFetcher">shuffleFetcher: <span name="spark.ShuffleFetcher" class="extype">ShuffleFetcher</span></span>, <span name="broadcastManager">broadcastManager: <span name="spark.broadcast.BroadcastManager" class="extype">BroadcastManager</span></span>, <span name="blockManager">blockManager: <span name="spark.storage.BlockManager" class="extype">BlockManager</span></span>, <span name="connectionManager">connectionManager: <span name="spark.network.ConnectionManager" class="extype">ConnectionManager</span></span>, <span name="httpFileServer">httpFileServer: <span name="spark.HttpFileServer" class="extype">HttpFileServer</span></span>, <span name="sparkFilesDir">sparkFilesDir: String</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.SparkEnv#actorSystem" data-isabs="false"> + <a id="actorSystem:ActorSystem"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">actorSystem</span><span class="result">: <span name="akka.actor.ActorSystem" class="extype">ActorSystem</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.SparkEnv#blockManager" data-isabs="false"> + <a id="blockManager:BlockManager"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">blockManager</span><span class="result">: <span name="spark.storage.BlockManager" class="extype">BlockManager</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkEnv#broadcastManager" data-isabs="false"> + <a id="broadcastManager:BroadcastManager"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">broadcastManager</span><span class="result">: <span name="spark.broadcast.BroadcastManager" class="extype">BroadcastManager</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkEnv#cacheManager" data-isabs="false"> + <a id="cacheManager:CacheManager"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">cacheManager</span><span class="result">: <span name="spark.CacheManager" class="extype">CacheManager</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.SparkEnv#closureSerializer" data-isabs="false"> + <a id="closureSerializer:Serializer"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">closureSerializer</span><span class="result">: <a name="spark.serializer.Serializer" class="extype" href="serializer/Serializer.html">Serializer</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkEnv#connectionManager" data-isabs="false"> + <a id="connectionManager:ConnectionManager"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">connectionManager</span><span class="result">: <span name="spark.network.ConnectionManager" class="extype">ConnectionManager</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.SparkEnv#executorId" data-isabs="false"> + <a id="executorId:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">executorId</span><span class="result">: String</span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.SparkEnv#httpFileServer" data-isabs="false"> + <a id="httpFileServer:HttpFileServer"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">httpFileServer</span><span class="result">: <span name="spark.HttpFileServer" class="extype">HttpFileServer</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.SparkEnv#mapOutputTracker" data-isabs="false"> + <a id="mapOutputTracker:MapOutputTracker"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">mapOutputTracker</span><span class="result">: <span name="spark.MapOutputTracker" class="extype">MapOutputTracker</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.SparkEnv#serializer" data-isabs="false"> + <a id="serializer:Serializer"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">serializer</span><span class="result">: <a name="spark.serializer.Serializer" class="extype" href="serializer/Serializer.html">Serializer</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkEnv#shuffleFetcher" data-isabs="false"> + <a id="shuffleFetcher:ShuffleFetcher"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">shuffleFetcher</span><span class="result">: <span name="spark.ShuffleFetcher" class="extype">ShuffleFetcher</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkEnv#sparkFilesDir" data-isabs="false"> + <a id="sparkFilesDir:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">sparkFilesDir</span><span class="result">: String</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkEnv#stop" data-isabs="false"> + <a id="stop():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">stop</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/SparkException.html b/site/docs/0.7.0/api/core/spark/SparkException.html new file mode 100644 index 000000000..5848d8e46 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/SparkException.html @@ -0,0 +1,508 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.SparkException</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>SparkException</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">SparkException</span><span class="result"> extends <span name="java.lang.Exception" class="extype">Exception</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="java.lang.Exception" class="extype">Exception</span>, <span name="java.lang.Throwable" class="extype">Throwable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.SparkException" class="in"><span>SparkException</span></li><li name="java.lang.Exception" class="in"><span>Exception</span></li><li name="java.lang.Throwable" class="in"><span>Throwable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.SparkException#this" data-isabs="false"> + <a id="this:SparkException"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">SparkException</span><span class="params">(<span name="message">message: String</span>)</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkException#this" data-isabs="false"> + <a id="this:SparkException"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">SparkException</span><span class="params">(<span name="message">message: String</span>, <span name="cause">cause: Throwable</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="java.lang.Throwable#fillInStackTrace" data-isabs="false"> + <a id="fillInStackTrace():Throwable"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fillInStackTrace</span><span class="params">()</span><span class="result">: <span name="java.lang.Throwable" class="extype">Throwable</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Throwable</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="java.lang.Throwable#getCause" data-isabs="false"> + <a id="getCause():Throwable"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCause</span><span class="params">()</span><span class="result">: <span name="java.lang.Throwable" class="extype">Throwable</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Throwable</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="java.lang.Throwable#getLocalizedMessage" data-isabs="false"> + <a id="getLocalizedMessage():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getLocalizedMessage</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Throwable</dd></dl></div> + </li><li visbl="pub" name="java.lang.Throwable#getMessage" data-isabs="false"> + <a id="getMessage():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getMessage</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Throwable</dd></dl></div> + </li><li visbl="pub" name="java.lang.Throwable#getStackTrace" data-isabs="false"> + <a id="getStackTrace():Array[StackTraceElement]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStackTrace</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<span name="java.lang.StackTraceElement" class="extype">StackTraceElement</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Throwable</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="java.lang.Throwable#initCause" data-isabs="false"> + <a id="initCause(Throwable):Throwable"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initCause</span><span class="params">(<span name="arg0">arg0: <span name="java.lang.Throwable" class="extype">Throwable</span></span>)</span><span class="result">: <span name="java.lang.Throwable" class="extype">Throwable</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Throwable</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="java.lang.Throwable#printStackTrace" data-isabs="false"> + <a id="printStackTrace(PrintWriter):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">printStackTrace</span><span class="params">(<span name="arg0">arg0: <span name="java.io.PrintWriter" class="extype">PrintWriter</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Throwable</dd></dl></div> + </li><li visbl="pub" name="java.lang.Throwable#printStackTrace" data-isabs="false"> + <a id="printStackTrace(PrintStream):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">printStackTrace</span><span class="params">(<span name="arg0">arg0: <span name="java.io.PrintStream" class="extype">PrintStream</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Throwable</dd></dl></div> + </li><li visbl="pub" name="java.lang.Throwable#printStackTrace" data-isabs="false"> + <a id="printStackTrace():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">printStackTrace</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Throwable</dd></dl></div> + </li><li visbl="pub" name="java.lang.Throwable#setStackTrace" data-isabs="false"> + <a id="setStackTrace(Array[StackTraceElement]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setStackTrace</span><span class="params">(<span name="arg0">arg0: <span name="scala.Array" class="extype">Array</span>[<span name="java.lang.StackTraceElement" class="extype">StackTraceElement</span>]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Throwable</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="java.lang.Throwable#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Throwable → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="java.lang.Exception" class="parent"> + <h3>Inherited from <span name="java.lang.Exception" class="extype">Exception</span></h3> + </div><div name="java.lang.Throwable" class="parent"> + <h3>Inherited from <span name="java.lang.Throwable" class="extype">Throwable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/SparkFiles$.html b/site/docs/0.7.0/api/core/spark/SparkFiles$.html new file mode 100644 index 000000000..35e442192 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/SparkFiles$.html @@ -0,0 +1,97 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.SparkFiles</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="SparkFiles.html"><img src="../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1><a title="Go to companion" href="SparkFiles.html">SparkFiles</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">SparkFiles</span><span class="result"> extends </span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.SparkFiles#get" data-isabs="false"> + <a id="get(String):String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">get</span><span class="params">(<span name="filename">filename: <span name="java.lang.String" class="extype">String</span></span>)</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkFiles#getRootDirectory" data-isabs="false"> + <a id="getRootDirectory():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getRootDirectory</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/SparkFiles.html b/site/docs/0.7.0/api/core/spark/SparkFiles.html new file mode 100644 index 000000000..2dcc95929 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/SparkFiles.html @@ -0,0 +1,355 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.SparkFiles</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="SparkFiles$.html"><img src="../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1><a title="Go to companion" href="SparkFiles$.html">SparkFiles</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">SparkFiles</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent">AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.SparkFiles" class="in"><span>SparkFiles</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/Split.html b/site/docs/0.7.0/api/core/spark/Split.html new file mode 100644 index 000000000..1783a4548 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/Split.html @@ -0,0 +1,376 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.Split</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/trait_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>Split</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <span class="name">Split</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A partition of an RDD. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.Split" class="in"><span>Split</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.Split#index" data-isabs="true"> + <a id="index:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">index</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">Get the split's index within its parent RDD +</p> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.Split#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Split" class="extype" href="">Split</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/TaskContext.html b/site/docs/0.7.0/api/core/spark/TaskContext.html new file mode 100644 index 000000000..143b62680 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/TaskContext.html @@ -0,0 +1,446 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.TaskContext</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="package.html">spark</a></p> + <h1>TaskContext</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">TaskContext</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.TaskContext" class="in"><span>TaskContext</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.TaskContext#this" data-isabs="false"> + <a id="this:TaskContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">TaskContext</span><span class="params">(<span name="stageId">stageId: <span name="scala.Int" class="extype">Int</span></span>, <span name="splitId">splitId: <span name="scala.Int" class="extype">Int</span></span>, <span name="attemptId">attemptId: <span name="scala.Long" class="extype">Long</span></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.TaskContext#addOnCompleteCallback" data-isabs="false"> + <a id="addOnCompleteCallback(() ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addOnCompleteCallback</span><span class="params">(<span name="f">f: () ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.TaskContext#attemptId" data-isabs="false"> + <a id="attemptId:Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">attemptId</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.TaskContext#executeOnCompleteCallbacks" data-isabs="false"> + <a id="executeOnCompleteCallbacks():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">executeOnCompleteCallbacks</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.TaskContext#onCompleteCallbacks" data-isabs="false"> + <a id="onCompleteCallbacks:ArrayBuffer[() ⇒ Unit]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">onCompleteCallbacks</span><span class="result">: <span name="scala.collection.mutable.ArrayBuffer" class="extype">ArrayBuffer</span>[() ⇒ <span name="scala.Unit" class="extype">Unit</span>]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.TaskContext#splitId" data-isabs="false"> + <a id="splitId:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">splitId</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.TaskContext#stageId" data-isabs="false"> + <a id="stageId:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">stageId</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/JavaDoubleRDD$.html b/site/docs/0.7.0/api/core/spark/api/java/JavaDoubleRDD$.html new file mode 100644 index 000000000..51a2abdd8 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/JavaDoubleRDD$.html @@ -0,0 +1,395 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.JavaDoubleRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="JavaDoubleRDD.html"><img src="../../../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.api" class="extype" href="../package.html">api</a>.<a name="spark.api.java" class="extype" href="package.html">java</a></p> + <h1><a title="Go to companion" href="JavaDoubleRDD.html">JavaDoubleRDD</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">JavaDoubleRDD</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.JavaDoubleRDD" class="in"><span>JavaDoubleRDD</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#fromRDD" data-isabs="false"> + <a id="fromRDD(RDD[Double]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fromRDD</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[<span name="scala.Double" class="extype">Double</span>]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="spark.api.java.JavaDoubleRDD#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#toRDD" data-isabs="false"> + <a id="toRDD(JavaDoubleRDD):RDD[Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toRDD</span><span class="params">(<span name="rdd">rdd: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[<span name="scala.Double" class="extype">Double</span>]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/JavaDoubleRDD.html b/site/docs/0.7.0/api/core/spark/api/java/JavaDoubleRDD.html new file mode 100644 index 000000000..291124128 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/JavaDoubleRDD.html @@ -0,0 +1,1263 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.JavaDoubleRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="JavaDoubleRDD$.html"><img src="../../../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.api" class="extype" href="../package.html">api</a>.<a name="spark.api.java" class="extype" href="package.html">java</a></p> + <h1><a title="Go to companion" href="JavaDoubleRDD$.html">JavaDoubleRDD</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">JavaDoubleRDD</span><span class="result"> extends <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a>[<span name="java.lang.Double" class="extype">Double</span>, <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a>[<span name="java.lang.Double" class="extype">Double</span>, <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a>], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.JavaDoubleRDD" class="in"><span>JavaDoubleRDD</span></li><li name="spark.api.java.JavaRDDLike" class="in"><span>JavaRDDLike</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.api.java.JavaDoubleRDD#this" data-isabs="false"> + <a id="this:JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">JavaDoubleRDD</span><span class="params">(<span name="srdd">srdd: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[<span name="scala.Double" class="extype">Double</span>]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#aggregate" data-isabs="false"> + <a id="aggregate[U](U)(Function2[U, Double, U],Function2[U, U, U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[U, <span name="java.lang.Double" class="extype">Double</span>, U]</span>, <span name="combOp">combOp: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[U, U, U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#cache" data-isabs="false"> + <a id="cache():JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#cartesian" data-isabs="false"> + <a id="cartesian[U](spark.api.java.JavaRDDLike[U, _]):JavaPairRDD[Double, U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: spark.api.java.JavaRDDLike[U, _]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[<span name="java.lang.Double" class="extype">Double</span>, U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#checkpoint" data-isabs="false"> + <a id="checkpoint():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpoint</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Mark this RDD for checkpointing.</p><div class="fullcomment"><div class="comment cmt"><p>Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint +directory set with SparkContext.setCheckpointDir() and all references to its parent +RDDs will be removed. This function must be called before any job has been +executed on this RDD. It is strongly recommended that this RDD is persisted in +memory, otherwise saving it on a file will require recomputation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#classManifest" data-isabs="false"> + <a id="classManifest:ClassManifest[Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">classManifest</span><span class="result">: ClassManifest[<span name="java.lang.Double" class="extype">Double</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a> → <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#coalesce" data-isabs="false"> + <a id="coalesce(Int):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">coalesce</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD that is reduced into <code>numPartitions</code> partitions.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#collect" data-isabs="false"> + <a id="collect():List[Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="java.util.List" class="extype">List</span>[<span name="java.lang.Double" class="extype">Double</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countApprox" data-isabs="false"> + <a id="countApprox(Long):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countByValue" data-isabs="false"> + <a id="countByValue():Map[Double, Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="java.util.Map" class="extype">Map</span>[<span name="java.lang.Double" class="extype">Double</span>, <span name="java.lang.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long):PartialResult[Map[Double, BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<span name="java.util.Map" class="extype">Map</span>[<span name="java.lang.Double" class="extype">Double</span>, <a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[Double, BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<span name="java.util.Map" class="extype">Map</span>[<span name="java.lang.Double" class="extype">Double</span>, <a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#distinct" data-isabs="false"> + <a id="distinct(Int):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#distinct" data-isabs="false"> + <a id="distinct():JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">()</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#filter" data-isabs="false"> + <a id="filter(Function[Double, Boolean]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[<span name="java.lang.Double" class="extype">Double</span>, <span name="java.lang.Boolean" class="extype">Boolean</span>]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#first" data-isabs="false"> + <a id="first():Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: <span name="java.lang.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a> → <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#flatMap" data-isabs="false"> + <a id="flatMap[K2, V2](PairFlatMapFunction[Double, K2, V2]):JavaPairRDD[K2, V2]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="K2">K2</span>, <span name="V2">V2</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.PairFlatMapFunction" class="extype" href="function/PairFlatMapFunction.html">PairFlatMapFunction</a>[<span name="java.lang.Double" class="extype">Double</span>, K2, V2]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K2, V2]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#flatMap" data-isabs="false"> + <a id="flatMap(DoubleFlatMapFunction[Double]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.DoubleFlatMapFunction" class="extype" href="function/DoubleFlatMapFunction.html">DoubleFlatMapFunction</a>[<span name="java.lang.Double" class="extype">Double</span>]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#flatMap" data-isabs="false"> + <a id="flatMap[U](FlatMapFunction[Double, U]):JavaRDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.FlatMapFunction" class="extype" href="function/FlatMapFunction.html">FlatMapFunction</a>[<span name="java.lang.Double" class="extype">Double</span>, U]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#fold" data-isabs="false"> + <a id="fold(Double)(Function2[Double, Double, Double]):Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: <span name="java.lang.Double" class="extype">Double</span></span>)</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[<span name="java.lang.Double" class="extype">Double</span>, <span name="java.lang.Double" class="extype">Double</span>, <span name="java.lang.Double" class="extype">Double</span>]</span>)</span><span class="result">: <span name="java.lang.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#foreach" data-isabs="false"> + <a id="foreach(VoidFunction[Double]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.VoidFunction" class="extype" href="function/VoidFunction.html">VoidFunction</a>[<span name="java.lang.Double" class="extype">Double</span>]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#getCheckpointFile" data-isabs="false"> + <a id="getCheckpointFile():Optional[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCheckpointFile</span><span class="params">()</span><span class="result">: <span name="com.google.common.base.Optional" class="extype">Optional</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Gets the name of the file to which this RDD was checkpointed +</p><div class="fullcomment"><div class="comment cmt"><p>Gets the name of the file to which this RDD was checkpointed +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#glom" data-isabs="false"> + <a id="glom():JavaRDD[List[Double]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[<span name="java.util.List" class="extype">List</span>[<span name="java.lang.Double" class="extype">Double</span>]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#groupBy" data-isabs="false"> + <a id="groupBy[K](Function[Double, K],Int):JavaPairRDD[K, List[Double]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[<span name="java.lang.Double" class="extype">Double</span>, K]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, <span name="java.util.List" class="extype">List</span>[<span name="java.lang.Double" class="extype">Double</span>]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#groupBy" data-isabs="false"> + <a id="groupBy[K](Function[Double, K]):JavaPairRDD[K, List[Double]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[<span name="java.lang.Double" class="extype">Double</span>, K]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, <span name="java.util.List" class="extype">List</span>[<span name="java.lang.Double" class="extype">Double</span>]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#isCheckpointed" data-isabs="false"> + <a id="isCheckpointed:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isCheckpointed</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return whether this RDD has been checkpointed or not +</p><div class="fullcomment"><div class="comment cmt"><p>Return whether this RDD has been checkpointed or not +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#iterator" data-isabs="false"> + <a id="iterator(Partition,TaskContext):Iterator[Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../../Partition.html">Partition</a></span>, <span name="taskContext">taskContext: <a name="spark.TaskContext" class="extype" href="../../TaskContext.html">TaskContext</a></span>)</span><span class="result">: <span name="java.util.Iterator" class="extype">Iterator</span>[<span name="java.lang.Double" class="extype">Double</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#keyBy" data-isabs="false"> + <a id="keyBy[K](Function[Double, K]):JavaPairRDD[K, Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[<span name="java.lang.Double" class="extype">Double</span>, K]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, <span name="java.lang.Double" class="extype">Double</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Creates tuples of the elements in this RDD by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Creates tuples of the elements in this RDD by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#map" data-isabs="false"> + <a id="map[K2, V2](PairFunction[Double, K2, V2]):JavaPairRDD[K2, V2]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="K2">K2</span>, <span name="V2">V2</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.PairFunction" class="extype" href="function/PairFunction.html">PairFunction</a>[<span name="java.lang.Double" class="extype">Double</span>, K2, V2]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K2, V2]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#map" data-isabs="false"> + <a id="map[R](DoubleFunction[Double]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="R">R</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.DoubleFunction" class="extype" href="function/DoubleFunction.html">DoubleFunction</a>[<span name="java.lang.Double" class="extype">Double</span>]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#map" data-isabs="false"> + <a id="map[R](Function[Double, R]):JavaRDD[R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="R">R</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[<span name="java.lang.Double" class="extype">Double</span>, R]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[R]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#mapPartitions" data-isabs="false"> + <a id="mapPartitions[K2, V2](PairFlatMapFunction[Iterator[Double], K2, V2]):JavaPairRDD[K2, V2]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="K2">K2</span>, <span name="V2">V2</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.PairFlatMapFunction" class="extype" href="function/PairFlatMapFunction.html">PairFlatMapFunction</a>[<span name="java.util.Iterator" class="extype">Iterator</span>[<span name="java.lang.Double" class="extype">Double</span>], K2, V2]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K2, V2]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#mapPartitions" data-isabs="false"> + <a id="mapPartitions(DoubleFlatMapFunction[Iterator[Double]]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.DoubleFlatMapFunction" class="extype" href="function/DoubleFlatMapFunction.html">DoubleFlatMapFunction</a>[<span name="java.util.Iterator" class="extype">Iterator</span>[<span name="java.lang.Double" class="extype">Double</span>]]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U](FlatMapFunction[Iterator[Double], U]):JavaRDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.FlatMapFunction" class="extype" href="function/FlatMapFunction.html">FlatMapFunction</a>[<span name="java.util.Iterator" class="extype">Iterator</span>[<span name="java.lang.Double" class="extype">Double</span>], U]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#mean" data-isabs="false"> + <a id="mean():Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mean</span><span class="params">()</span><span class="result">: <span name="java.lang.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the mean of the elements in this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#meanApprox" data-isabs="false"> + <a id="meanApprox(Long):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">meanApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the approximate mean of the elements in this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#meanApprox" data-isabs="false"> + <a id="meanApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">meanApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="java.lang.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the approximate mean of the elements in this RDD.</p> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#pipe" data-isabs="false"> + <a id="pipe(List[String],Map[String, String]):JavaRDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: <span name="java.util.List" class="extype">List</span>[String]</span>, <span name="env">env: <span name="java.util.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#pipe" data-isabs="false"> + <a id="pipe(List[String]):JavaRDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: <span name="java.util.List" class="extype">List</span>[String]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#pipe" data-isabs="false"> + <a id="pipe(String):JavaRDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#rdd" data-isabs="false"> + <a id="rdd:RDD[Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">rdd</span><span class="result">: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[<span name="java.lang.Double" class="extype">Double</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a> → <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#reduce" data-isabs="false"> + <a id="reduce(Function2[Double, Double, Double]):Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[<span name="java.lang.Double" class="extype">Double</span>, <span name="java.lang.Double" class="extype">Double</span>, <span name="java.lang.Double" class="extype">Double</span>]</span>)</span><span class="result">: <span name="java.lang.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified commutative and associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified commutative and associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="java.lang.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#splits" data-isabs="false"> + <a id="splits:List[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">splits</span><span class="result">: <span name="java.util.List" class="extype">List</span>[<a name="spark.Partition" class="extype" href="../../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Set of partitions in this RDD.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#srdd" data-isabs="false"> + <a id="srdd:RDD[Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">srdd</span><span class="result">: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[<span name="scala.Double" class="extype">Double</span>]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#stats" data-isabs="false"> + <a id="stats():StatCounter"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">stats</span><span class="params">()</span><span class="result">: <a name="spark.util.StatCounter" class="extype" href="../../util/StatCounter.html">StatCounter</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return a spark.StatCounter describing the elements in this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#stdev" data-isabs="false"> + <a id="stdev():Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">stdev</span><span class="params">()</span><span class="result">: <span name="java.lang.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the standard deviation of the elements in this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#subtract" data-isabs="false"> + <a id="subtract(JavaDoubleRDD,Partitioner):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#subtract" data-isabs="false"> + <a id="subtract(JavaDoubleRDD,Int):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#subtract" data-isabs="false"> + <a id="subtract(JavaDoubleRDD):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><p>Uses <code>this</code> partitioner/partition size, because even if <code>other</code> is huge, the resulting +RDD will be <= us. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#sum" data-isabs="false"> + <a id="sum():Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sum</span><span class="params">()</span><span class="result">: <span name="java.lang.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the sum of the elements in this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#sumApprox" data-isabs="false"> + <a id="sumApprox(Long):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sumApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the approximate sum of the elements in this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#sumApprox" data-isabs="false"> + <a id="sumApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sumApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="java.lang.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the approximate sum of the elements in this RDD.</p> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#take" data-isabs="false"> + <a id="take(Int):List[Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="java.util.List" class="extype">List</span>[<span name="java.lang.Double" class="extype">Double</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):List[Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="java.util.List" class="extype">List</span>[<span name="java.lang.Double" class="extype">Double</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#toDebugString" data-isabs="false"> + <a id="toDebugString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toDebugString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A description of this RDD and its recursive dependencies for debugging.</p><div class="fullcomment"><div class="comment cmt"><p>A description of this RDD and its recursive dependencies for debugging.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#union" data-isabs="false"> + <a id="union(JavaDoubleRDD):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#variance" data-isabs="false"> + <a id="variance():Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">variance</span><span class="params">()</span><span class="result">: <span name="java.lang.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the variance of the elements in this RDD.</p> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaDoubleRDD#wrapRDD" data-isabs="false"> + <a id="wrapRDD(RDD[Double]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wrapRDD</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[<span name="java.lang.Double" class="extype">Double</span>]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a> → <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#zip" data-isabs="false"> + <a id="zip[U](spark.api.java.JavaRDDLike[U, _]):JavaPairRDD[Double, U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: spark.api.java.JavaRDDLike[U, _]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[<span name="java.lang.Double" class="extype">Double</span>, U]</span> + </span> + </h4> + <p class="shortcomment cmt">Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc.</p><div class="fullcomment"><div class="comment cmt"><p>Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc. Assumes that the two RDDs have the *same number of +partitions* and the *same number of elements in each partition* (e.g. one was made through +a map on the other). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.api.java.JavaRDDLike" class="parent"> + <h3>Inherited from <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a>[<span name="java.lang.Double" class="extype">Double</span>, <a name="spark.api.java.JavaDoubleRDD" class="extype" href="">JavaDoubleRDD</a>]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/JavaPairRDD$.html b/site/docs/0.7.0/api/core/spark/api/java/JavaPairRDD$.html new file mode 100644 index 000000000..8b7d4a8db --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/JavaPairRDD$.html @@ -0,0 +1,431 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.JavaPairRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="JavaPairRDD.html"><img src="../../../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.api" class="extype" href="../package.html">api</a>.<a name="spark.api.java" class="extype" href="package.html">java</a></p> + <h1><a title="Go to companion" href="JavaPairRDD.html">JavaPairRDD</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">JavaPairRDD</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.JavaPairRDD" class="in"><span>JavaPairRDD</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#cogroupResult2ToJava" data-isabs="false"> + <a id="cogroupResult2ToJava[W1, W2, K, V](RDD[(K, (Seq[V], Seq[W1], Seq[W2]))])(ClassManifest[K]):RDD[(K, (List[V], List[W1], List[W2]))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cogroupResult2ToJava</span><span class="tparams">[<span name="W1">W1</span>, <span name="W2">W2</span>, <span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[(K, (Seq[V], Seq[W1], Seq[W2]))]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="kcm">kcm: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[(K, (<span name="java.util.List" class="extype">List</span>[V], <span name="java.util.List" class="extype">List</span>[W1], <span name="java.util.List" class="extype">List</span>[W2]))]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#cogroupResultToJava" data-isabs="false"> + <a id="cogroupResultToJava[W, K, V](RDD[(K, (Seq[V], Seq[W]))])(ClassManifest[K],ClassManifest[V]):RDD[(K, (List[V], List[W]))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cogroupResultToJava</span><span class="tparams">[<span name="W">W</span>, <span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[(K, (Seq[V], Seq[W]))]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="kcm">kcm: ClassManifest[K]</span>, <span name="vcm">vcm: ClassManifest[V]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[(K, (<span name="java.util.List" class="extype">List</span>[V], <span name="java.util.List" class="extype">List</span>[W]))]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#fromRDD" data-isabs="false"> + <a id="fromRDD[K, V](RDD[(K, V)])(ClassManifest[K],ClassManifest[V]):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fromRDD</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>, <span name="arg1">arg1: ClassManifest[V]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#groupByResultToJava" data-isabs="false"> + <a id="groupByResultToJava[K, T](RDD[(K, Seq[T])])(ClassManifest[K],ClassManifest[T]):RDD[(K, List[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupByResultToJava</span><span class="tparams">[<span name="K">K</span>, <span name="T">T</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[(K, Seq[T])]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="kcm">kcm: ClassManifest[K]</span>, <span name="vcm">vcm: ClassManifest[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[(K, <span name="java.util.List" class="extype">List</span>[T])]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="spark.api.java.JavaPairRDD#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#toRDD" data-isabs="false"> + <a id="toRDD[K, V](JavaPairRDD[K, V]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toRDD</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/JavaPairRDD.html b/site/docs/0.7.0/api/core/spark/api/java/JavaPairRDD.html new file mode 100644 index 000000000..7d27ffdd3 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/JavaPairRDD.html @@ -0,0 +1,1821 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.JavaPairRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="JavaPairRDD$.html"><img src="../../../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.api" class="extype" href="../package.html">api</a>.<a name="spark.api.java" class="extype" href="package.html">java</a></p> + <h1><a title="Go to companion" href="JavaPairRDD$.html">JavaPairRDD</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">JavaPairRDD</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a>[(K, V), <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a>[(K, V), <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.JavaPairRDD" class="in"><span>JavaPairRDD</span></li><li name="spark.api.java.JavaRDDLike" class="in"><span>JavaRDDLike</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.api.java.JavaPairRDD#this" data-isabs="false"> + <a id="this:JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">JavaPairRDD</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="kManifest">kManifest: ClassManifest[K]</span>, <span name="vManifest">vManifest: ClassManifest[V]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#aggregate" data-isabs="false"> + <a id="aggregate[U](U)(Function2[U, (K, V), U],Function2[U, U, U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[U, (K, V), U]</span>, <span name="combOp">combOp: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[U, U, U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#cache" data-isabs="false"> + <a id="cache():JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#cartesian" data-isabs="false"> + <a id="cartesian[U](spark.api.java.JavaRDDLike[U, _]):JavaPairRDD[(K, V), U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: spark.api.java.JavaRDDLike[U, _]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[(K, V), U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#checkpoint" data-isabs="false"> + <a id="checkpoint():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpoint</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Mark this RDD for checkpointing.</p><div class="fullcomment"><div class="comment cmt"><p>Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint +directory set with SparkContext.setCheckpointDir() and all references to its parent +RDDs will be removed. This function must be called before any job has been +executed on this RDD. It is strongly recommended that this RDD is persisted in +memory, otherwise saving it on a file will require recomputation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#classManifest" data-isabs="false"> + <a id="classManifest:ClassManifest[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">classManifest</span><span class="result">: ClassManifest[(K, V)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a> → <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#coalesce" data-isabs="false"> + <a id="coalesce(Int):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">coalesce</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD that is reduced into <code>numPartitions</code> partitions.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#cogroup" data-isabs="false"> + <a id="cogroup[W1, W2](JavaPairRDD[K, W1],JavaPairRDD[K, W2],Int):JavaPairRDD[K, (List[V], List[W1], List[W2])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cogroup</span><span class="tparams">[<span name="W1">W1</span>, <span name="W2">W2</span>]</span><span class="params">(<span name="other1">other1: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W1]</span>, <span name="other2">other2: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W2]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (<span name="java.util.List" class="extype">List</span>[V], <span name="java.util.List" class="extype">List</span>[W1], <span name="java.util.List" class="extype">List</span>[W2])]</span> + </span> + </h4> + <p class="shortcomment cmt">For each key k in <code>this</code> or <code>other1</code> or <code>other2</code>, return a resulting RDD that contains a +tuple with the list of values for that key in <code>this</code>, <code>other1</code> and <code>other2</code>.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#cogroup" data-isabs="false"> + <a id="cogroup[W](JavaPairRDD[K, W],Int):JavaPairRDD[K, (List[V], List[W])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cogroup</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (<span name="java.util.List" class="extype">List</span>[V], <span name="java.util.List" class="extype">List</span>[W])]</span> + </span> + </h4> + <p class="shortcomment cmt">For each key k in <code>this</code> or <code>other</code>, return a resulting RDD that contains a tuple with the +list of values for that key in <code>this</code> as well as <code>other</code>.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#cogroup" data-isabs="false"> + <a id="cogroup[W1, W2](JavaPairRDD[K, W1],JavaPairRDD[K, W2]):JavaPairRDD[K, (List[V], List[W1], List[W2])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cogroup</span><span class="tparams">[<span name="W1">W1</span>, <span name="W2">W2</span>]</span><span class="params">(<span name="other1">other1: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W1]</span>, <span name="other2">other2: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W2]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (<span name="java.util.List" class="extype">List</span>[V], <span name="java.util.List" class="extype">List</span>[W1], <span name="java.util.List" class="extype">List</span>[W2])]</span> + </span> + </h4> + <p class="shortcomment cmt">For each key k in <code>this</code> or <code>other1</code> or <code>other2</code>, return a resulting RDD that contains a +tuple with the list of values for that key in <code>this</code>, <code>other1</code> and <code>other2</code>.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#cogroup" data-isabs="false"> + <a id="cogroup[W](JavaPairRDD[K, W]):JavaPairRDD[K, (List[V], List[W])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cogroup</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (<span name="java.util.List" class="extype">List</span>[V], <span name="java.util.List" class="extype">List</span>[W])]</span> + </span> + </h4> + <p class="shortcomment cmt">For each key k in <code>this</code> or <code>other</code>, return a resulting RDD that contains a tuple with the +list of values for that key in <code>this</code> as well as <code>other</code>.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#cogroup" data-isabs="false"> + <a id="cogroup[W1, W2](JavaPairRDD[K, W1],JavaPairRDD[K, W2],Partitioner):JavaPairRDD[K, (List[V], List[W1], List[W2])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cogroup</span><span class="tparams">[<span name="W1">W1</span>, <span name="W2">W2</span>]</span><span class="params">(<span name="other1">other1: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W1]</span>, <span name="other2">other2: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W2]</span>, <span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="../../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (<span name="java.util.List" class="extype">List</span>[V], <span name="java.util.List" class="extype">List</span>[W1], <span name="java.util.List" class="extype">List</span>[W2])]</span> + </span> + </h4> + <p class="shortcomment cmt">For each key k in <code>this</code> or <code>other1</code> or <code>other2</code>, return a resulting RDD that contains a +tuple with the list of values for that key in <code>this</code>, <code>other1</code> and <code>other2</code>.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#cogroup" data-isabs="false"> + <a id="cogroup[W](JavaPairRDD[K, W],Partitioner):JavaPairRDD[K, (List[V], List[W])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cogroup</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W]</span>, <span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="../../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (<span name="java.util.List" class="extype">List</span>[V], <span name="java.util.List" class="extype">List</span>[W])]</span> + </span> + </h4> + <p class="shortcomment cmt">For each key k in <code>this</code> or <code>other</code>, return a resulting RDD that contains a tuple with the +list of values for that key in <code>this</code> as well as <code>other</code>.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#collect" data-isabs="false"> + <a id="collect():List[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="java.util.List" class="extype">List</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#collectAsMap" data-isabs="false"> + <a id="collectAsMap():Map[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collectAsMap</span><span class="params">()</span><span class="result">: <span name="java.util.Map" class="extype">Map</span>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the key-value pairs in this RDD to the master as a Map.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#combineByKey" data-isabs="false"> + <a id="combineByKey[C](Function[V, C],Function2[C, V, C],Function2[C, C, C]):JavaPairRDD[K, C]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">combineByKey</span><span class="tparams">[<span name="C">C</span>]</span><span class="params">(<span name="createCombiner">createCombiner: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[V, C]</span>, <span name="mergeValue">mergeValue: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[C, V, C]</span>, <span name="mergeCombiners">mergeCombiners: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[C, C, C]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, C]</span> + </span> + </h4> + <p class="shortcomment cmt">Simplified version of combineByKey that hash-partitions the resulting RDD using the existing +partitioner/parallelism level.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#combineByKey" data-isabs="false"> + <a id="combineByKey[C](Function[V, C],Function2[C, V, C],Function2[C, C, C],Int):JavaPairRDD[K, C]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">combineByKey</span><span class="tparams">[<span name="C">C</span>]</span><span class="params">(<span name="createCombiner">createCombiner: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[V, C]</span>, <span name="mergeValue">mergeValue: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[C, V, C]</span>, <span name="mergeCombiners">mergeCombiners: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[C, C, C]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, C]</span> + </span> + </h4> + <p class="shortcomment cmt">Simplified version of combineByKey that hash-partitions the output RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#combineByKey" data-isabs="false"> + <a id="combineByKey[C](Function[V, C],Function2[C, V, C],Function2[C, C, C],Partitioner):JavaPairRDD[K, C]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">combineByKey</span><span class="tparams">[<span name="C">C</span>]</span><span class="params">(<span name="createCombiner">createCombiner: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[V, C]</span>, <span name="mergeValue">mergeValue: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[C, V, C]</span>, <span name="mergeCombiners">mergeCombiners: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[C, C, C]</span>, <span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="../../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, C]</span> + </span> + </h4> + <p class="shortcomment cmt">Generic function to combine the elements for each key using a custom set of aggregation +functions.</p><div class="fullcomment"><div class="comment cmt"><p>Generic function to combine the elements for each key using a custom set of aggregation +functions. Turns a JavaPairRDD[(K, V)] into a result of type JavaPairRDD[(K, C)], for a +"combined type" C * Note that V and C can be different -- for example, one might group an +RDD of type (Int, Int) into an RDD of type (Int, List[Int]). Users provide three +functions:</p><p>- <code>createCombiner</code>, which turns a V into a C (e.g., creates a one-element list) +- <code>mergeValue</code>, to merge a V into a C (e.g., adds it to the end of a list) +- <code>mergeCombiners</code>, to combine two C's into a single one.</p><p>In addition, users can control the partitioning of the output RDD, and whether to perform +map-side aggregation (if a mapper can produce multiple items with the same key). +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countApprox" data-isabs="false"> + <a id="countApprox(Long):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#countByKey" data-isabs="false"> + <a id="countByKey():Map[K, Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByKey</span><span class="params">()</span><span class="result">: <span name="java.util.Map" class="extype">Map</span>[K, <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Count the number of elements for each key, and return the result to the master as a Map.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#countByKeyApprox" data-isabs="false"> + <a id="countByKeyApprox(Long,Double):PartialResult[Map[K, BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByKeyApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<span name="java.util.Map" class="extype">Map</span>[K, <a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByKey that can return a partial result if it does +not finish within a timeout.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#countByKeyApprox" data-isabs="false"> + <a id="countByKeyApprox(Long):PartialResult[Map[K, BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByKeyApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<span name="java.util.Map" class="extype">Map</span>[K, <a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByKey that can return a partial result if it does +not finish within a timeout.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countByValue" data-isabs="false"> + <a id="countByValue():Map[(K, V), Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="java.util.Map" class="extype">Map</span>[(K, V), <span name="java.lang.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long):PartialResult[Map[(K, V), BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<span name="java.util.Map" class="extype">Map</span>[(K, V), <a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[(K, V), BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<span name="java.util.Map" class="extype">Map</span>[(K, V), <a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#distinct" data-isabs="false"> + <a id="distinct(Int):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#distinct" data-isabs="false"> + <a id="distinct():JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">()</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#filter" data-isabs="false"> + <a id="filter(Function[(K, V), Boolean]):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[(K, V), <span name="java.lang.Boolean" class="extype">Boolean</span>]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#first" data-isabs="false"> + <a id="first():(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a> → <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#flatMap" data-isabs="false"> + <a id="flatMap[K2, V2](PairFlatMapFunction[(K, V), K2, V2]):JavaPairRDD[K2, V2]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="K2">K2</span>, <span name="V2">V2</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.PairFlatMapFunction" class="extype" href="function/PairFlatMapFunction.html">PairFlatMapFunction</a>[(K, V), K2, V2]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K2, V2]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#flatMap" data-isabs="false"> + <a id="flatMap(DoubleFlatMapFunction[(K, V)]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.DoubleFlatMapFunction" class="extype" href="function/DoubleFlatMapFunction.html">DoubleFlatMapFunction</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#flatMap" data-isabs="false"> + <a id="flatMap[U](FlatMapFunction[(K, V), U]):JavaRDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.FlatMapFunction" class="extype" href="function/FlatMapFunction.html">FlatMapFunction</a>[(K, V), U]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#flatMapValues" data-isabs="false"> + <a id="flatMapValues[U](Function[V, Iterable[U]]):JavaPairRDD[K, U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMapValues</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[V, <span name="java.lang.Iterable" class="extype">Iterable</span>[U]]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, U]</span> + </span> + </h4> + <p class="shortcomment cmt">Pass each value in the key-value pair RDD through a flatMap function without changing the +keys; this also retains the original RDD's partitioning.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#fold" data-isabs="false"> + <a id="fold((K, V))(Function2[(K, V), (K, V), (K, V)]):(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: (K, V)</span>)</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[(K, V), (K, V), (K, V)]</span>)</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#foreach" data-isabs="false"> + <a id="foreach(VoidFunction[(K, V)]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.VoidFunction" class="extype" href="function/VoidFunction.html">VoidFunction</a>[(K, V)]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#getCheckpointFile" data-isabs="false"> + <a id="getCheckpointFile():Optional[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCheckpointFile</span><span class="params">()</span><span class="result">: <span name="com.google.common.base.Optional" class="extype">Optional</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Gets the name of the file to which this RDD was checkpointed +</p><div class="fullcomment"><div class="comment cmt"><p>Gets the name of the file to which this RDD was checkpointed +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#glom" data-isabs="false"> + <a id="glom():JavaRDD[List[(K, V)]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[<span name="java.util.List" class="extype">List</span>[(K, V)]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#groupBy" data-isabs="false"> + <a id="groupBy[K](Function[(K, V), K],Int):JavaPairRDD[K, List[(K, V)]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[(K, V), K]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, <span name="java.util.List" class="extype">List</span>[(K, V)]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#groupBy" data-isabs="false"> + <a id="groupBy[K](Function[(K, V), K]):JavaPairRDD[K, List[(K, V)]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[(K, V), K]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, <span name="java.util.List" class="extype">List</span>[(K, V)]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#groupByKey" data-isabs="false"> + <a id="groupByKey():JavaPairRDD[K, List[V]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupByKey</span><span class="params">()</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, <span name="java.util.List" class="extype">List</span>[V]]</span> + </span> + </h4> + <p class="shortcomment cmt">Group the values for each key in the RDD into a single sequence.</p><div class="fullcomment"><div class="comment cmt"><p>Group the values for each key in the RDD into a single sequence. Hash-partitions the +resulting RDD with the existing partitioner/parallelism level. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#groupByKey" data-isabs="false"> + <a id="groupByKey(Int):JavaPairRDD[K, List[V]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupByKey</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, <span name="java.util.List" class="extype">List</span>[V]]</span> + </span> + </h4> + <p class="shortcomment cmt">Group the values for each key in the RDD into a single sequence.</p><div class="fullcomment"><div class="comment cmt"><p>Group the values for each key in the RDD into a single sequence. Hash-partitions the +resulting RDD with into <code>numPartitions</code> partitions. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#groupByKey" data-isabs="false"> + <a id="groupByKey(Partitioner):JavaPairRDD[K, List[V]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupByKey</span><span class="params">(<span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="../../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, <span name="java.util.List" class="extype">List</span>[V]]</span> + </span> + </h4> + <p class="shortcomment cmt">Group the values for each key in the RDD into a single sequence.</p><div class="fullcomment"><div class="comment cmt"><p>Group the values for each key in the RDD into a single sequence. Allows controlling the +partitioning of the resulting key-value pair RDD by passing a Partitioner. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#groupWith" data-isabs="false"> + <a id="groupWith[W1, W2](JavaPairRDD[K, W1],JavaPairRDD[K, W2]):JavaPairRDD[K, (List[V], List[W1], List[W2])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupWith</span><span class="tparams">[<span name="W1">W1</span>, <span name="W2">W2</span>]</span><span class="params">(<span name="other1">other1: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W1]</span>, <span name="other2">other2: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W2]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (<span name="java.util.List" class="extype">List</span>[V], <span name="java.util.List" class="extype">List</span>[W1], <span name="java.util.List" class="extype">List</span>[W2])]</span> + </span> + </h4> + <p class="shortcomment cmt">Alias for cogroup.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#groupWith" data-isabs="false"> + <a id="groupWith[W](JavaPairRDD[K, W]):JavaPairRDD[K, (List[V], List[W])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupWith</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (<span name="java.util.List" class="extype">List</span>[V], <span name="java.util.List" class="extype">List</span>[W])]</span> + </span> + </h4> + <p class="shortcomment cmt">Alias for cogroup.</p> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#isCheckpointed" data-isabs="false"> + <a id="isCheckpointed:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isCheckpointed</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return whether this RDD has been checkpointed or not +</p><div class="fullcomment"><div class="comment cmt"><p>Return whether this RDD has been checkpointed or not +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#iterator" data-isabs="false"> + <a id="iterator(Partition,TaskContext):Iterator[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../../Partition.html">Partition</a></span>, <span name="taskContext">taskContext: <a name="spark.TaskContext" class="extype" href="../../TaskContext.html">TaskContext</a></span>)</span><span class="result">: <span name="java.util.Iterator" class="extype">Iterator</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#join" data-isabs="false"> + <a id="join[W](JavaPairRDD[K, W],Int):JavaPairRDD[K, (V, W)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">join</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (V, W)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD containing all pairs of elements with matching keys in <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD containing all pairs of elements with matching keys in <code>this</code> and <code>other</code>. Each +pair of elements will be returned as a (k, (v1, v2)) tuple, where (k, v1) is in <code>this</code> and +(k, v2) is in <code>other</code>. Performs a hash join across the cluster. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#join" data-isabs="false"> + <a id="join[W](JavaPairRDD[K, W]):JavaPairRDD[K, (V, W)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">join</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (V, W)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD containing all pairs of elements with matching keys in <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD containing all pairs of elements with matching keys in <code>this</code> and <code>other</code>. Each +pair of elements will be returned as a (k, (v1, v2)) tuple, where (k, v1) is in <code>this</code> and +(k, v2) is in <code>other</code>. Performs a hash join across the cluster. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#join" data-isabs="false"> + <a id="join[W](JavaPairRDD[K, W],Partitioner):JavaPairRDD[K, (V, W)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">join</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W]</span>, <span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="../../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (V, W)]</span> + </span> + </h4> + <p class="shortcomment cmt">Merge the values for each key using an associative reduce function.</p><div class="fullcomment"><div class="comment cmt"><p>Merge the values for each key using an associative reduce function. This will also perform +the merging locally on each mapper before sending results to a reducer, similarly to a +"combiner" in MapReduce. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#kManifest" data-isabs="false"> + <a id="kManifest:ClassManifest[K]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">kManifest</span><span class="result">: ClassManifest[K]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#keyBy" data-isabs="false"> + <a id="keyBy[K](Function[(K, V), K]):JavaPairRDD[K, (K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[(K, V), K]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Creates tuples of the elements in this RDD by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Creates tuples of the elements in this RDD by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#keys" data-isabs="false"> + <a id="keys():JavaRDD[K]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keys</span><span class="params">()</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[K]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the keys of each tuple.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#leftOuterJoin" data-isabs="false"> + <a id="leftOuterJoin[W](JavaPairRDD[K, W],Int):JavaPairRDD[K, (V, Option[W])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">leftOuterJoin</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (V, <span name="scala.Option" class="extype">Option</span>[W])]</span> + </span> + </h4> + <p class="shortcomment cmt">Perform a left outer join of <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Perform a left outer join of <code>this</code> and <code>other</code>. For each element (k, v) in <code>this</code>, the +resulting RDD will either contain all pairs (k, (v, Some(w))) for w in <code>other</code>, or the +pair (k, (v, None)) if no elements in <code>other</code> have key k. Hash-partitions the output +into <code>numPartitions</code> partitions. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#leftOuterJoin" data-isabs="false"> + <a id="leftOuterJoin[W](JavaPairRDD[K, W]):JavaPairRDD[K, (V, Option[W])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">leftOuterJoin</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (V, <span name="scala.Option" class="extype">Option</span>[W])]</span> + </span> + </h4> + <p class="shortcomment cmt">Perform a left outer join of <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Perform a left outer join of <code>this</code> and <code>other</code>. For each element (k, v) in <code>this</code>, the +resulting RDD will either contain all pairs (k, (v, Some(w))) for w in <code>other</code>, or the +pair (k, (v, None)) if no elements in <code>other</code> have key k. Hash-partitions the output +using the existing partitioner/parallelism level. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#leftOuterJoin" data-isabs="false"> + <a id="leftOuterJoin[W](JavaPairRDD[K, W],Partitioner):JavaPairRDD[K, (V, Option[W])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">leftOuterJoin</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W]</span>, <span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="../../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (V, <span name="scala.Option" class="extype">Option</span>[W])]</span> + </span> + </h4> + <p class="shortcomment cmt">Perform a left outer join of <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Perform a left outer join of <code>this</code> and <code>other</code>. For each element (k, v) in <code>this</code>, the +resulting RDD will either contain all pairs (k, (v, Some(w))) for w in <code>other</code>, or the +pair (k, (v, None)) if no elements in <code>other</code> have key k. Uses the given Partitioner to +partition the output RDD. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#lookup" data-isabs="false"> + <a id="lookup(K):List[V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">lookup</span><span class="params">(<span name="key">key: K</span>)</span><span class="result">: <span name="java.util.List" class="extype">List</span>[V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the list of values in the RDD for key <code>key</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the list of values in the RDD for key <code>key</code>. This operation is done efficiently if the +RDD has a known partitioner by only searching the partition that the key maps to. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#map" data-isabs="false"> + <a id="map[K2, V2](PairFunction[(K, V), K2, V2]):JavaPairRDD[K2, V2]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="K2">K2</span>, <span name="V2">V2</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.PairFunction" class="extype" href="function/PairFunction.html">PairFunction</a>[(K, V), K2, V2]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K2, V2]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#map" data-isabs="false"> + <a id="map[R](DoubleFunction[(K, V)]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="R">R</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.DoubleFunction" class="extype" href="function/DoubleFunction.html">DoubleFunction</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#map" data-isabs="false"> + <a id="map[R](Function[(K, V), R]):JavaRDD[R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="R">R</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[(K, V), R]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[R]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#mapPartitions" data-isabs="false"> + <a id="mapPartitions[K2, V2](PairFlatMapFunction[Iterator[(K, V)], K2, V2]):JavaPairRDD[K2, V2]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="K2">K2</span>, <span name="V2">V2</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.PairFlatMapFunction" class="extype" href="function/PairFlatMapFunction.html">PairFlatMapFunction</a>[<span name="java.util.Iterator" class="extype">Iterator</span>[(K, V)], K2, V2]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K2, V2]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#mapPartitions" data-isabs="false"> + <a id="mapPartitions(DoubleFlatMapFunction[Iterator[(K, V)]]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.DoubleFlatMapFunction" class="extype" href="function/DoubleFlatMapFunction.html">DoubleFlatMapFunction</a>[<span name="java.util.Iterator" class="extype">Iterator</span>[(K, V)]]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U](FlatMapFunction[Iterator[(K, V)], U]):JavaRDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.FlatMapFunction" class="extype" href="function/FlatMapFunction.html">FlatMapFunction</a>[<span name="java.util.Iterator" class="extype">Iterator</span>[(K, V)], U]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#mapValues" data-isabs="false"> + <a id="mapValues[U](Function[V, U]):JavaPairRDD[K, U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapValues</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[V, U]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, U]</span> + </span> + </h4> + <p class="shortcomment cmt">Pass each value in the key-value pair RDD through a map function without changing the keys; +this also retains the original RDD's partitioning.</p> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#partitionBy" data-isabs="false"> + <a id="partitionBy(Partitioner):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">partitionBy</span><span class="params">(<span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="../../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a copy of the RDD partitioned using the specified partitioner.</p><div class="fullcomment"><div class="comment cmt"><p>Return a copy of the RDD partitioned using the specified partitioner. If <code>mapSideCombine</code> +is true, Spark will group values of the same key together on the map side before the +repartitioning, to only send each key over the network once. If a large number of +duplicated keys are expected, and the size of the keys are large, <code>mapSideCombine</code> should +be set to true. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#pipe" data-isabs="false"> + <a id="pipe(List[String],Map[String, String]):JavaRDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: <span name="java.util.List" class="extype">List</span>[String]</span>, <span name="env">env: <span name="java.util.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#pipe" data-isabs="false"> + <a id="pipe(List[String]):JavaRDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: <span name="java.util.List" class="extype">List</span>[String]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#pipe" data-isabs="false"> + <a id="pipe(String):JavaRDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#rdd" data-isabs="false"> + <a id="rdd:RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">rdd</span><span class="result">: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a> → <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#reduce" data-isabs="false"> + <a id="reduce(Function2[(K, V), (K, V), (K, V)]):(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[(K, V), (K, V), (K, V)]</span>)</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified commutative and associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified commutative and associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#reduceByKey" data-isabs="false"> + <a id="reduceByKey(Function2[V, V, V]):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceByKey</span><span class="params">(<span name="func">func: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[V, V, V]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Merge the values for each key using an associative reduce function.</p><div class="fullcomment"><div class="comment cmt"><p>Merge the values for each key using an associative reduce function. This will also perform +the merging locally on each mapper before sending results to a reducer, similarly to a +"combiner" in MapReduce. Output will be hash-partitioned with the existing partitioner/ +parallelism level. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#reduceByKey" data-isabs="false"> + <a id="reduceByKey(Function2[V, V, V],Int):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceByKey</span><span class="params">(<span name="func">func: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[V, V, V]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Merge the values for each key using an associative reduce function.</p><div class="fullcomment"><div class="comment cmt"><p>Merge the values for each key using an associative reduce function. This will also perform +the merging locally on each mapper before sending results to a reducer, similarly to a +"combiner" in MapReduce. Output will be hash-partitioned with numPartitions partitions. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#reduceByKey" data-isabs="false"> + <a id="reduceByKey(Partitioner,Function2[V, V, V]):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceByKey</span><span class="params">(<span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="../../Partitioner.html">Partitioner</a></span>, <span name="func">func: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[V, V, V]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Merge the values for each key using an associative reduce function.</p><div class="fullcomment"><div class="comment cmt"><p>Merge the values for each key using an associative reduce function. This will also perform +the merging locally on each mapper before sending results to a reducer, similarly to a +"combiner" in MapReduce. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#reduceByKeyLocally" data-isabs="false"> + <a id="reduceByKeyLocally(Function2[V, V, V]):Map[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceByKeyLocally</span><span class="params">(<span name="func">func: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[V, V, V]</span>)</span><span class="result">: <span name="java.util.Map" class="extype">Map</span>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Merge the values for each key using an associative reduce function, but return the results +immediately to the master as a Map.</p><div class="fullcomment"><div class="comment cmt"><p>Merge the values for each key using an associative reduce function, but return the results +immediately to the master as a Map. This will also perform the merging locally on each mapper +before sending results to a reducer, similarly to a "combiner" in MapReduce. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#rightOuterJoin" data-isabs="false"> + <a id="rightOuterJoin[W](JavaPairRDD[K, W],Int):JavaPairRDD[K, (Option[V], W)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">rightOuterJoin</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (<span name="scala.Option" class="extype">Option</span>[V], W)]</span> + </span> + </h4> + <p class="shortcomment cmt">Perform a right outer join of <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Perform a right outer join of <code>this</code> and <code>other</code>. For each element (k, w) in <code>other</code>, the +resulting RDD will either contain all pairs (k, (Some(v), w)) for v in <code>this</code>, or the +pair (k, (None, w)) if no elements in <code>this</code> have key k. Hash-partitions the resulting +RDD into the given number of partitions. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#rightOuterJoin" data-isabs="false"> + <a id="rightOuterJoin[W](JavaPairRDD[K, W]):JavaPairRDD[K, (Option[V], W)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">rightOuterJoin</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (<span name="scala.Option" class="extype">Option</span>[V], W)]</span> + </span> + </h4> + <p class="shortcomment cmt">Perform a right outer join of <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Perform a right outer join of <code>this</code> and <code>other</code>. For each element (k, w) in <code>other</code>, the +resulting RDD will either contain all pairs (k, (Some(v), w)) for v in <code>this</code>, or the +pair (k, (None, w)) if no elements in <code>this</code> have key k. Hash-partitions the resulting +RDD using the existing partitioner/parallelism level. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#rightOuterJoin" data-isabs="false"> + <a id="rightOuterJoin[W](JavaPairRDD[K, W],Partitioner):JavaPairRDD[K, (Option[V], W)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">rightOuterJoin</span><span class="tparams">[<span name="W">W</span>]</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, W]</span>, <span name="partitioner">partitioner: <a name="spark.Partitioner" class="extype" href="../../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, (<span name="scala.Option" class="extype">Option</span>[V], W)]</span> + </span> + </h4> + <p class="shortcomment cmt">Perform a right outer join of <code>this</code> and <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Perform a right outer join of <code>this</code> and <code>other</code>. For each element (k, w) in <code>other</code>, the +resulting RDD will either contain all pairs (k, (Some(v), w)) for v in <code>this</code>, or the +pair (k, (None, w)) if no elements in <code>this</code> have key k. Uses the given Partitioner to +partition the output RDD. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#saveAsHadoopDataset" data-isabs="false"> + <a id="saveAsHadoopDataset(JobConf):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsHadoopDataset</span><span class="params">(<span name="conf">conf: <span name="org.apache.hadoop.mapred.JobConf" class="extype">JobConf</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Output the RDD to any Hadoop-supported storage system, using a Hadoop JobConf object for +that storage system.</p><div class="fullcomment"><div class="comment cmt"><p>Output the RDD to any Hadoop-supported storage system, using a Hadoop JobConf object for +that storage system. The JobConf should set an OutputFormat and any output paths required +(e.g. a table name to write to) in the same way as it would be configured for a Hadoop +MapReduce job. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#saveAsHadoopFile" data-isabs="false"> + <a id="saveAsHadoopFile[F<:org.apache.hadoop.mapred.OutputFormat[_, _]](String,Class[_],Class[_],Class[F]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsHadoopFile</span><span class="tparams">[<span name="F">F <: org.apache.hadoop.mapred.OutputFormat[_, _]</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="keyClass">keyClass: Class[_]</span>, <span name="valueClass">valueClass: Class[_]</span>, <span name="outputFormatClass">outputFormatClass: Class[F]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Output the RDD to any Hadoop-supported file system.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#saveAsHadoopFile" data-isabs="false"> + <a id="saveAsHadoopFile[F<:org.apache.hadoop.mapred.OutputFormat[_, _]](String,Class[_],Class[_],Class[F],JobConf):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsHadoopFile</span><span class="tparams">[<span name="F">F <: org.apache.hadoop.mapred.OutputFormat[_, _]</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="keyClass">keyClass: Class[_]</span>, <span name="valueClass">valueClass: Class[_]</span>, <span name="outputFormatClass">outputFormatClass: Class[F]</span>, <span name="conf">conf: <span name="org.apache.hadoop.mapred.JobConf" class="extype">JobConf</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Output the RDD to any Hadoop-supported file system.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#saveAsNewAPIHadoopFile" data-isabs="false"> + <a id="saveAsNewAPIHadoopFile[F<:org.apache.hadoop.mapreduce.OutputFormat[_, _]](String,Class[_],Class[_],Class[F]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsNewAPIHadoopFile</span><span class="tparams">[<span name="F">F <: org.apache.hadoop.mapreduce.OutputFormat[_, _]</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="keyClass">keyClass: Class[_]</span>, <span name="valueClass">valueClass: Class[_]</span>, <span name="outputFormatClass">outputFormatClass: Class[F]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Output the RDD to any Hadoop-supported file system.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#saveAsNewAPIHadoopFile" data-isabs="false"> + <a id="saveAsNewAPIHadoopFile[F<:org.apache.hadoop.mapreduce.OutputFormat[_, _]](String,Class[_],Class[_],Class[F],Configuration):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsNewAPIHadoopFile</span><span class="tparams">[<span name="F">F <: org.apache.hadoop.mapreduce.OutputFormat[_, _]</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="keyClass">keyClass: Class[_]</span>, <span name="valueClass">valueClass: Class[_]</span>, <span name="outputFormatClass">outputFormatClass: Class[F]</span>, <span name="conf">conf: <span name="org.apache.hadoop.conf.Configuration" class="extype">Configuration</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Output the RDD to any Hadoop-supported file system.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#sortByKey" data-isabs="false"> + <a id="sortByKey(Comparator[K],Boolean):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sortByKey</span><span class="params">(<span name="comp">comp: <span name="java.util.Comparator" class="extype">Comparator</span>[K]</span>, <span name="ascending">ascending: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Sort the RDD by key, so that each partition contains a sorted range of the elements.</p><div class="fullcomment"><div class="comment cmt"><p>Sort the RDD by key, so that each partition contains a sorted range of the elements. Calling +<code>collect</code> or <code>save</code> on the resulting RDD will return or output an ordered list of records +(in the <code>save</code> case, they will be written to multiple <code>part-X</code> files in the filesystem, in +order of the keys). +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#sortByKey" data-isabs="false"> + <a id="sortByKey(Comparator[K]):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sortByKey</span><span class="params">(<span name="comp">comp: <span name="java.util.Comparator" class="extype">Comparator</span>[K]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Sort the RDD by key, so that each partition contains a sorted range of the elements.</p><div class="fullcomment"><div class="comment cmt"><p>Sort the RDD by key, so that each partition contains a sorted range of the elements. Calling +<code>collect</code> or <code>save</code> on the resulting RDD will return or output an ordered list of records +(in the <code>save</code> case, they will be written to multiple <code>part-X</code> files in the filesystem, in +order of the keys). +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#sortByKey" data-isabs="false"> + <a id="sortByKey(Boolean):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sortByKey</span><span class="params">(<span name="ascending">ascending: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Sort the RDD by key, so that each partition contains a sorted range of the elements.</p><div class="fullcomment"><div class="comment cmt"><p>Sort the RDD by key, so that each partition contains a sorted range of the elements. Calling +<code>collect</code> or <code>save</code> on the resulting RDD will return or output an ordered list of records +(in the <code>save</code> case, they will be written to multiple <code>part-X</code> files in the filesystem, in +order of the keys). +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#sortByKey" data-isabs="false"> + <a id="sortByKey():JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sortByKey</span><span class="params">()</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Sort the RDD by key, so that each partition contains a sorted range of the elements in +ascending order.</p><div class="fullcomment"><div class="comment cmt"><p>Sort the RDD by key, so that each partition contains a sorted range of the elements in +ascending order. Calling <code>collect</code> or <code>save</code> on the resulting RDD will return or output an +ordered list of records (in the <code>save</code> case, they will be written to multiple <code>part-X</code> files +in the filesystem, in order of the keys). +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#splits" data-isabs="false"> + <a id="splits:List[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">splits</span><span class="result">: <span name="java.util.List" class="extype">List</span>[<a name="spark.Partition" class="extype" href="../../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Set of partitions in this RDD.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#subtract" data-isabs="false"> + <a id="subtract(JavaPairRDD[K, V],Partitioner):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#subtract" data-isabs="false"> + <a id="subtract(JavaPairRDD[K, V],Int):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#subtract" data-isabs="false"> + <a id="subtract(JavaPairRDD[K, V]):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><p>Uses <code>this</code> partitioner/partition size, because even if <code>other</code> is huge, the resulting +RDD will be <= us. +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#take" data-isabs="false"> + <a id="take(Int):List[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="java.util.List" class="extype">List</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):List[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="java.util.List" class="extype">List</span>[(K, V)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#toDebugString" data-isabs="false"> + <a id="toDebugString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toDebugString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A description of this RDD and its recursive dependencies for debugging.</p><div class="fullcomment"><div class="comment cmt"><p>A description of this RDD and its recursive dependencies for debugging.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#union" data-isabs="false"> + <a id="union(JavaPairRDD[K, V]):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#vManifest" data-isabs="false"> + <a id="vManifest:ClassManifest[V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">vManifest</span><span class="result">: ClassManifest[V]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#values" data-isabs="false"> + <a id="values():JavaRDD[V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">values</span><span class="params">()</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[V]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the values of each tuple.</p> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaPairRDD#wrapRDD" data-isabs="false"> + <a id="wrapRDD(RDD[(K, V)]):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wrapRDD</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a> → <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#zip" data-isabs="false"> + <a id="zip[U](spark.api.java.JavaRDDLike[U, _]):JavaPairRDD[(K, V), U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: spark.api.java.JavaRDDLike[U, _]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[(K, V), U]</span> + </span> + </h4> + <p class="shortcomment cmt">Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc.</p><div class="fullcomment"><div class="comment cmt"><p>Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc. Assumes that the two RDDs have the *same number of +partitions* and the *same number of elements in each partition* (e.g. one was made through +a map on the other). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.api.java.JavaRDDLike" class="parent"> + <h3>Inherited from <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a>[(K, V), <a name="spark.api.java.JavaPairRDD" class="extype" href="">JavaPairRDD</a>[K, V]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/JavaRDD$.html b/site/docs/0.7.0/api/core/spark/api/java/JavaRDD$.html new file mode 100644 index 000000000..0e45b3895 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/JavaRDD$.html @@ -0,0 +1,395 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.JavaRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="JavaRDD.html"><img src="../../../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.api" class="extype" href="../package.html">api</a>.<a name="spark.api.java" class="extype" href="package.html">java</a></p> + <h1><a title="Go to companion" href="JavaRDD.html">JavaRDD</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">JavaRDD</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.JavaRDD" class="in"><span>JavaRDD</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDD#fromRDD" data-isabs="false"> + <a id="fromRDD[T](RDD[T])(ClassManifest[T]):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fromRDD</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[T]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[T]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="spark.api.java.JavaRDD#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDD#toRDD" data-isabs="false"> + <a id="toRDD[T](JavaRDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toRDD</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[T]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/JavaRDD.html b/site/docs/0.7.0/api/core/spark/api/java/JavaRDD.html new file mode 100644 index 000000000..346678e4a --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/JavaRDD.html @@ -0,0 +1,1143 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.JavaRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="JavaRDD$.html"><img src="../../../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.api" class="extype" href="../package.html">api</a>.<a name="spark.api.java" class="extype" href="package.html">java</a></p> + <h1><a title="Go to companion" href="JavaRDD$.html">JavaRDD</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">JavaRDD</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a>[T, <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a>[T, <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.JavaRDD" class="in"><span>JavaRDD</span></li><li name="spark.api.java.JavaRDDLike" class="in"><span>JavaRDDLike</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.api.java.JavaRDD#this" data-isabs="false"> + <a id="this:JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">JavaRDD</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[T]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="classManifest">classManifest: ClassManifest[T]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#aggregate" data-isabs="false"> + <a id="aggregate[U](U)(Function2[U, T, U],Function2[U, U, U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[U, T, U]</span>, <span name="combOp">combOp: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[U, U, U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDD#cache" data-isabs="false"> + <a id="cache():JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#cartesian" data-isabs="false"> + <a id="cartesian[U](spark.api.java.JavaRDDLike[U, _]):JavaPairRDD[T, U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: spark.api.java.JavaRDDLike[U, _]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[T, U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#checkpoint" data-isabs="false"> + <a id="checkpoint():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpoint</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Mark this RDD for checkpointing.</p><div class="fullcomment"><div class="comment cmt"><p>Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint +directory set with SparkContext.setCheckpointDir() and all references to its parent +RDDs will be removed. This function must be called before any job has been +executed on this RDD. It is strongly recommended that this RDD is persisted in +memory, otherwise saving it on a file will require recomputation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDD#classManifest" data-isabs="false"> + <a id="classManifest:ClassManifest[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">classManifest</span><span class="result">: ClassManifest[T]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a> → <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDD#coalesce" data-isabs="false"> + <a id="coalesce(Int):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">coalesce</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD that is reduced into <code>numPartitions</code> partitions.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#collect" data-isabs="false"> + <a id="collect():List[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="java.util.List" class="extype">List</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countApprox" data-isabs="false"> + <a id="countApprox(Long):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countByValue" data-isabs="false"> + <a id="countByValue():Map[T, Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="java.util.Map" class="extype">Map</span>[T, <span name="java.lang.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long):PartialResult[Map[T, BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<span name="java.util.Map" class="extype">Map</span>[T, <a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[T, BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<span name="java.util.Map" class="extype">Map</span>[T, <a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDD#distinct" data-isabs="false"> + <a id="distinct(Int):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDD#distinct" data-isabs="false"> + <a id="distinct():JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">()</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDD#filter" data-isabs="false"> + <a id="filter(Function[T, Boolean]):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[T, <span name="java.lang.Boolean" class="extype">Boolean</span>]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#first" data-isabs="false"> + <a id="first():T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#flatMap" data-isabs="false"> + <a id="flatMap[K2, V2](PairFlatMapFunction[T, K2, V2]):JavaPairRDD[K2, V2]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="K2">K2</span>, <span name="V2">V2</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.PairFlatMapFunction" class="extype" href="function/PairFlatMapFunction.html">PairFlatMapFunction</a>[T, K2, V2]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K2, V2]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#flatMap" data-isabs="false"> + <a id="flatMap(DoubleFlatMapFunction[T]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.DoubleFlatMapFunction" class="extype" href="function/DoubleFlatMapFunction.html">DoubleFlatMapFunction</a>[T]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#flatMap" data-isabs="false"> + <a id="flatMap[U](FlatMapFunction[T, U]):JavaRDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.FlatMapFunction" class="extype" href="function/FlatMapFunction.html">FlatMapFunction</a>[T, U]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#fold" data-isabs="false"> + <a id="fold(T)(Function2[T, T, T]):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: T</span>)</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[T, T, T]</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#foreach" data-isabs="false"> + <a id="foreach(VoidFunction[T]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.VoidFunction" class="extype" href="function/VoidFunction.html">VoidFunction</a>[T]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#getCheckpointFile" data-isabs="false"> + <a id="getCheckpointFile():Optional[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCheckpointFile</span><span class="params">()</span><span class="result">: <span name="com.google.common.base.Optional" class="extype">Optional</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Gets the name of the file to which this RDD was checkpointed +</p><div class="fullcomment"><div class="comment cmt"><p>Gets the name of the file to which this RDD was checkpointed +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#glom" data-isabs="false"> + <a id="glom():JavaRDD[List[T]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[<span name="java.util.List" class="extype">List</span>[T]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#groupBy" data-isabs="false"> + <a id="groupBy[K](Function[T, K],Int):JavaPairRDD[K, List[T]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[T, K]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, <span name="java.util.List" class="extype">List</span>[T]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#groupBy" data-isabs="false"> + <a id="groupBy[K](Function[T, K]):JavaPairRDD[K, List[T]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[T, K]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, <span name="java.util.List" class="extype">List</span>[T]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#isCheckpointed" data-isabs="false"> + <a id="isCheckpointed:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isCheckpointed</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return whether this RDD has been checkpointed or not +</p><div class="fullcomment"><div class="comment cmt"><p>Return whether this RDD has been checkpointed or not +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#iterator" data-isabs="false"> + <a id="iterator(Partition,TaskContext):Iterator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../../Partition.html">Partition</a></span>, <span name="taskContext">taskContext: <a name="spark.TaskContext" class="extype" href="../../TaskContext.html">TaskContext</a></span>)</span><span class="result">: <span name="java.util.Iterator" class="extype">Iterator</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#keyBy" data-isabs="false"> + <a id="keyBy[K](Function[T, K]):JavaPairRDD[K, T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[T, K]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, T]</span> + </span> + </h4> + <p class="shortcomment cmt">Creates tuples of the elements in this RDD by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Creates tuples of the elements in this RDD by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#map" data-isabs="false"> + <a id="map[K2, V2](PairFunction[T, K2, V2]):JavaPairRDD[K2, V2]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="K2">K2</span>, <span name="V2">V2</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.PairFunction" class="extype" href="function/PairFunction.html">PairFunction</a>[T, K2, V2]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K2, V2]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#map" data-isabs="false"> + <a id="map[R](DoubleFunction[T]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="R">R</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.DoubleFunction" class="extype" href="function/DoubleFunction.html">DoubleFunction</a>[T]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#map" data-isabs="false"> + <a id="map[R](Function[T, R]):JavaRDD[R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="R">R</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[T, R]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[R]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#mapPartitions" data-isabs="false"> + <a id="mapPartitions[K2, V2](PairFlatMapFunction[Iterator[T], K2, V2]):JavaPairRDD[K2, V2]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="K2">K2</span>, <span name="V2">V2</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.PairFlatMapFunction" class="extype" href="function/PairFlatMapFunction.html">PairFlatMapFunction</a>[<span name="java.util.Iterator" class="extype">Iterator</span>[T], K2, V2]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K2, V2]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#mapPartitions" data-isabs="false"> + <a id="mapPartitions(DoubleFlatMapFunction[Iterator[T]]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.DoubleFlatMapFunction" class="extype" href="function/DoubleFlatMapFunction.html">DoubleFlatMapFunction</a>[<span name="java.util.Iterator" class="extype">Iterator</span>[T]]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U](FlatMapFunction[Iterator[T], U]):JavaRDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.FlatMapFunction" class="extype" href="function/FlatMapFunction.html">FlatMapFunction</a>[<span name="java.util.Iterator" class="extype">Iterator</span>[T], U]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#pipe" data-isabs="false"> + <a id="pipe(List[String],Map[String, String]):JavaRDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: <span name="java.util.List" class="extype">List</span>[String]</span>, <span name="env">env: <span name="java.util.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#pipe" data-isabs="false"> + <a id="pipe(List[String]):JavaRDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: <span name="java.util.List" class="extype">List</span>[String]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#pipe" data-isabs="false"> + <a id="pipe(String):JavaRDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDD#rdd" data-isabs="false"> + <a id="rdd:RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">rdd</span><span class="result">: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a> → <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#reduce" data-isabs="false"> + <a id="reduce(Function2[T, T, T]):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[T, T, T]</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified commutative and associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified commutative and associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#splits" data-isabs="false"> + <a id="splits:List[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">splits</span><span class="result">: <span name="java.util.List" class="extype">List</span>[<a name="spark.Partition" class="extype" href="../../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Set of partitions in this RDD.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDD#subtract" data-isabs="false"> + <a id="subtract(JavaRDD[T],Partitioner):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDD#subtract" data-isabs="false"> + <a id="subtract(JavaRDD[T],Int):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDD#subtract" data-isabs="false"> + <a id="subtract(JavaRDD[T]):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><p>Uses <code>this</code> partitioner/partition size, because even if <code>other</code> is huge, the resulting +RDD will be <= us. +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#take" data-isabs="false"> + <a id="take(Int):List[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="java.util.List" class="extype">List</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):List[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="java.util.List" class="extype">List</span>[T]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#toDebugString" data-isabs="false"> + <a id="toDebugString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toDebugString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A description of this RDD and its recursive dependencies for debugging.</p><div class="fullcomment"><div class="comment cmt"><p>A description of this RDD and its recursive dependencies for debugging.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDD#union" data-isabs="false"> + <a id="union(JavaRDD[T]):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDD#wrapRDD" data-isabs="false"> + <a id="wrapRDD(RDD[T]):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wrapRDD</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a> → <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#zip" data-isabs="false"> + <a id="zip[U](spark.api.java.JavaRDDLike[U, _]):JavaPairRDD[T, U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: spark.api.java.JavaRDDLike[U, _]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[T, U]</span> + </span> + </h4> + <p class="shortcomment cmt">Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc.</p><div class="fullcomment"><div class="comment cmt"><p>Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc. Assumes that the two RDDs have the *same number of +partitions* and the *same number of elements in each partition* (e.g. one was made through +a map on the other). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a></dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.api.java.JavaRDDLike" class="parent"> + <h3>Inherited from <a name="spark.api.java.JavaRDDLike" class="extype" href="JavaRDDLike.html">JavaRDDLike</a>[T, <a name="spark.api.java.JavaRDD" class="extype" href="">JavaRDD</a>[T]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/JavaRDDLike.html b/site/docs/0.7.0/api/core/spark/api/java/JavaRDDLike.html new file mode 100644 index 000000000..617c827b4 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/JavaRDDLike.html @@ -0,0 +1,959 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.JavaRDDLike</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../../lib/trait_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.api" class="extype" href="../package.html">api</a>.<a name="spark.api.java" class="extype" href="package.html">java</a></p> + <h1>JavaRDDLike</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <span class="name">JavaRDDLike</span><span class="tparams">[<span name="T">T</span>, <span name="This">This <: <a name="spark.api.java.JavaRDDLike" class="extype" href="">JavaRDDLike</a>[T, This]</span>]</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div><div class="toggleContainer block"> + <span class="toggle">Known Subclasses</span> + <div class="subClasses hiddenContent"><a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a>, <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>, <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.JavaRDDLike" class="in"><span>JavaRDDLike</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.api.java.JavaRDDLike#classManifest" data-isabs="true"> + <a id="classManifest:ClassManifest[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit abstract </span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">classManifest</span><span class="result">: ClassManifest[T]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#rdd" data-isabs="true"> + <a id="rdd:RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">rdd</span><span class="result">: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[T]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#wrapRDD" data-isabs="true"> + <a id="wrapRDD(RDD[T]):This"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wrapRDD</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="../../RDD.html">RDD</a>[T]</span>)</span><span class="result">: This</span> + </span> + </h4> + + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#aggregate" data-isabs="false"> + <a id="aggregate[U](U)(Function2[U, T, U],Function2[U, U, U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[U, T, U]</span>, <span name="combOp">combOp: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[U, U, U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#cartesian" data-isabs="false"> + <a id="cartesian[U](spark.api.java.JavaRDDLike[U, _]):JavaPairRDD[T, U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: spark.api.java.JavaRDDLike[U, _]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[T, U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#checkpoint" data-isabs="false"> + <a id="checkpoint():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpoint</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Mark this RDD for checkpointing.</p><div class="fullcomment"><div class="comment cmt"><p>Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint +directory set with SparkContext.setCheckpointDir() and all references to its parent +RDDs will be removed. This function must be called before any job has been +executed on this RDD. It is strongly recommended that this RDD is persisted in +memory, otherwise saving it on a file will require recomputation. +</p></div></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#collect" data-isabs="false"> + <a id="collect():List[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="java.util.List" class="extype">List</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a> that this RDD was created on.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countApprox" data-isabs="false"> + <a id="countApprox(Long):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countByValue" data-isabs="false"> + <a id="countByValue():Map[T, Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="java.util.Map" class="extype">Map</span>[T, <span name="java.lang.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long):PartialResult[Map[T, BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<span name="java.util.Map" class="extype">Map</span>[T, <a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[T, BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../../partial/PartialResult.html">PartialResult</a>[<span name="java.util.Map" class="extype">Map</span>[T, <a name="spark.partial.BoundedDouble" class="extype" href="../../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#first" data-isabs="false"> + <a id="first():T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#flatMap" data-isabs="false"> + <a id="flatMap[K2, V2](PairFlatMapFunction[T, K2, V2]):JavaPairRDD[K2, V2]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="K2">K2</span>, <span name="V2">V2</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.PairFlatMapFunction" class="extype" href="function/PairFlatMapFunction.html">PairFlatMapFunction</a>[T, K2, V2]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K2, V2]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#flatMap" data-isabs="false"> + <a id="flatMap(DoubleFlatMapFunction[T]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.DoubleFlatMapFunction" class="extype" href="function/DoubleFlatMapFunction.html">DoubleFlatMapFunction</a>[T]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#flatMap" data-isabs="false"> + <a id="flatMap[U](FlatMapFunction[T, U]):JavaRDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.FlatMapFunction" class="extype" href="function/FlatMapFunction.html">FlatMapFunction</a>[T, U]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#fold" data-isabs="false"> + <a id="fold(T)(Function2[T, T, T]):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: T</span>)</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[T, T, T]</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#foreach" data-isabs="false"> + <a id="foreach(VoidFunction[T]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.VoidFunction" class="extype" href="function/VoidFunction.html">VoidFunction</a>[T]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#getCheckpointFile" data-isabs="false"> + <a id="getCheckpointFile():Optional[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCheckpointFile</span><span class="params">()</span><span class="result">: <span name="com.google.common.base.Optional" class="extype">Optional</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Gets the name of the file to which this RDD was checkpointed +</p> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#glom" data-isabs="false"> + <a id="glom():JavaRDD[List[T]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[<span name="java.util.List" class="extype">List</span>[T]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#groupBy" data-isabs="false"> + <a id="groupBy[K](Function[T, K],Int):JavaPairRDD[K, List[T]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[T, K]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, <span name="java.util.List" class="extype">List</span>[T]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#groupBy" data-isabs="false"> + <a id="groupBy[K](Function[T, K]):JavaPairRDD[K, List[T]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[T, K]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, <span name="java.util.List" class="extype">List</span>[T]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#isCheckpointed" data-isabs="false"> + <a id="isCheckpointed:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isCheckpointed</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return whether this RDD has been checkpointed or not +</p> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#iterator" data-isabs="false"> + <a id="iterator(Partition,TaskContext):Iterator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../../Partition.html">Partition</a></span>, <span name="taskContext">taskContext: <a name="spark.TaskContext" class="extype" href="../../TaskContext.html">TaskContext</a></span>)</span><span class="result">: <span name="java.util.Iterator" class="extype">Iterator</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#keyBy" data-isabs="false"> + <a id="keyBy[K](Function[T, K]):JavaPairRDD[K, T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[T, K]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, T]</span> + </span> + </h4> + <p class="shortcomment cmt">Creates tuples of the elements in this RDD by applying <code>f</code>.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#map" data-isabs="false"> + <a id="map[K2, V2](PairFunction[T, K2, V2]):JavaPairRDD[K2, V2]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="K2">K2</span>, <span name="V2">V2</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.PairFunction" class="extype" href="function/PairFunction.html">PairFunction</a>[T, K2, V2]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K2, V2]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#map" data-isabs="false"> + <a id="map[R](DoubleFunction[T]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="R">R</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.DoubleFunction" class="extype" href="function/DoubleFunction.html">DoubleFunction</a>[T]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#map" data-isabs="false"> + <a id="map[R](Function[T, R]):JavaRDD[R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="R">R</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function" class="extype" href="function/Function.html">Function</a>[T, R]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[R]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#mapPartitions" data-isabs="false"> + <a id="mapPartitions[K2, V2](PairFlatMapFunction[Iterator[T], K2, V2]):JavaPairRDD[K2, V2]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="K2">K2</span>, <span name="V2">V2</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.PairFlatMapFunction" class="extype" href="function/PairFlatMapFunction.html">PairFlatMapFunction</a>[<span name="java.util.Iterator" class="extype">Iterator</span>[T], K2, V2]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K2, V2]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#mapPartitions" data-isabs="false"> + <a id="mapPartitions(DoubleFlatMapFunction[Iterator[T]]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.DoubleFlatMapFunction" class="extype" href="function/DoubleFlatMapFunction.html">DoubleFlatMapFunction</a>[<span name="java.util.Iterator" class="extype">Iterator</span>[T]]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U](FlatMapFunction[Iterator[T], U]):JavaRDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.FlatMapFunction" class="extype" href="function/FlatMapFunction.html">FlatMapFunction</a>[<span name="java.util.Iterator" class="extype">Iterator</span>[T], U]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#pipe" data-isabs="false"> + <a id="pipe(List[String],Map[String, String]):JavaRDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: <span name="java.util.List" class="extype">List</span>[String]</span>, <span name="env">env: <span name="java.util.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#pipe" data-isabs="false"> + <a id="pipe(List[String]):JavaRDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: <span name="java.util.List" class="extype">List</span>[String]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#pipe" data-isabs="false"> + <a id="pipe(String):JavaRDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#reduce" data-isabs="false"> + <a id="reduce(Function2[T, T, T]):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.Function2" class="extype" href="function/Function2.html">Function2</a>[T, T, T]</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified commutative and associative binary operator.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#splits" data-isabs="false"> + <a id="splits:List[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">splits</span><span class="result">: <span name="java.util.List" class="extype">List</span>[<a name="spark.Partition" class="extype" href="../../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Set of partitions in this RDD.</p> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#take" data-isabs="false"> + <a id="take(Int):List[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="java.util.List" class="extype">List</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):List[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="java.util.List" class="extype">List</span>[T]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#toDebugString" data-isabs="false"> + <a id="toDebugString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toDebugString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A description of this RDD and its recursive dependencies for debugging.</p> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaRDDLike#zip" data-isabs="false"> + <a id="zip[U](spark.api.java.JavaRDDLike[U, _]):JavaPairRDD[T, U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: spark.api.java.JavaRDDLike[U, _]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[T, U]</span> + </span> + </h4> + <p class="shortcomment cmt">Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc.</p><div class="fullcomment"><div class="comment cmt"><p>Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc. Assumes that the two RDDs have the *same number of +partitions* and the *same number of elements in each partition* (e.g. one was made through +a map on the other). +</p></div></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/JavaSparkContext$.html b/site/docs/0.7.0/api/core/spark/api/java/JavaSparkContext$.html new file mode 100644 index 000000000..82fd89703 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/JavaSparkContext$.html @@ -0,0 +1,379 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.JavaSparkContext</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="JavaSparkContext.html"><img src="../../../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.api" class="extype" href="../package.html">api</a>.<a name="spark.api.java" class="extype" href="package.html">java</a></p> + <h1><a title="Go to companion" href="JavaSparkContext.html">JavaSparkContext</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">JavaSparkContext</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent">AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.JavaSparkContext" class="in"><span>JavaSparkContext</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#fromSparkContext" data-isabs="false"> + <a id="fromSparkContext(SparkContext):JavaSparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fromSparkContext</span><span class="params">(<span name="sc">sc: <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a></span>)</span><span class="result">: <a name="spark.api.java.JavaSparkContext" class="extype" href="JavaSparkContext.html">JavaSparkContext</a></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#toSparkContext" data-isabs="false"> + <a id="toSparkContext(JavaSparkContext):SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toSparkContext</span><span class="params">(<span name="jsc">jsc: <a name="spark.api.java.JavaSparkContext" class="extype" href="JavaSparkContext.html">JavaSparkContext</a></span>)</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/JavaSparkContext.html b/site/docs/0.7.0/api/core/spark/api/java/JavaSparkContext.html new file mode 100644 index 000000000..5c006c8f9 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/JavaSparkContext.html @@ -0,0 +1,1001 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.JavaSparkContext</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="JavaSparkContext$.html"><img src="../../../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.api" class="extype" href="../package.html">api</a>.<a name="spark.api.java" class="extype" href="package.html">java</a></p> + <h1><a title="Go to companion" href="JavaSparkContext$.html">JavaSparkContext</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">JavaSparkContext</span><span class="result"> extends <span name="spark.api.java.JavaSparkContextVarargsWorkaround" class="extype">JavaSparkContextVarargsWorkaround</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A Java-friendly version of <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a> that returns <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>s and +works with Java collections instead of Scala ones. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="spark.api.java.JavaSparkContextVarargsWorkaround" class="extype">JavaSparkContextVarargsWorkaround</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.JavaSparkContext" class="in"><span>JavaSparkContext</span></li><li name="spark.api.java.JavaSparkContextVarargsWorkaround" class="in"><span>JavaSparkContextVarargsWorkaround</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.api.java.JavaSparkContext#this" data-isabs="false"> + <a id="this:JavaSparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">JavaSparkContext</span><span class="params">(<span name="master">master: String</span>, <span name="appName">appName: String</span>, <span name="sparkHome">sparkHome: String</span>, <span name="jars">jars: <span name="scala.Array" class="extype">Array</span>[String]</span>, <span name="environment">environment: <span name="java.util.Map" class="extype">Map</span>[String, String]</span>)</span> + </span> + </h4> + <p class="shortcomment cmt"></p><div class="fullcomment"><div class="comment cmt"></div><dl class="paramcmts block"><dt class="param">master</dt><dd class="cmt"><p>Cluster URL to connect to (e.g. mesos://host:port, spark://host:port, local[4]).</p></dd><dt class="param">appName</dt><dd class="cmt"><p>A name for your application, to display on the cluster web UI</p></dd><dt class="param">sparkHome</dt><dd class="cmt"><p>The SPARK_HOME directory on the slave nodes</p></dd><dt class="param">jars</dt><dd class="cmt"><p>Collection of JARs to send to the cluster. These can be paths on the local file + system or HDFS, HTTP, HTTPS, or FTP URLs.</p></dd><dt class="param">environment</dt><dd class="cmt"><p>Environment variables to set on worker nodes +</p></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#this" data-isabs="false"> + <a id="this:JavaSparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">JavaSparkContext</span><span class="params">(<span name="master">master: String</span>, <span name="appName">appName: String</span>, <span name="sparkHome">sparkHome: String</span>, <span name="jars">jars: <span name="scala.Array" class="extype">Array</span>[String]</span>)</span> + </span> + </h4> + <p class="shortcomment cmt"></p><div class="fullcomment"><div class="comment cmt"></div><dl class="paramcmts block"><dt class="param">master</dt><dd class="cmt"><p>Cluster URL to connect to (e.g. mesos://host:port, spark://host:port, local[4]).</p></dd><dt class="param">appName</dt><dd class="cmt"><p>A name for your application, to display on the cluster web UI</p></dd><dt class="param">sparkHome</dt><dd class="cmt"><p>The SPARK_HOME directory on the slave nodes</p></dd><dt class="param">jars</dt><dd class="cmt"><p>Collection of JARs to send to the cluster. These can be paths on the local file + system or HDFS, HTTP, HTTPS, or FTP URLs. +</p></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#this" data-isabs="false"> + <a id="this:JavaSparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">JavaSparkContext</span><span class="params">(<span name="master">master: String</span>, <span name="appName">appName: String</span>, <span name="sparkHome">sparkHome: String</span>, <span name="jarFile">jarFile: String</span>)</span> + </span> + </h4> + <p class="shortcomment cmt"></p><div class="fullcomment"><div class="comment cmt"></div><dl class="paramcmts block"><dt class="param">master</dt><dd class="cmt"><p>Cluster URL to connect to (e.g. mesos://host:port, spark://host:port, local[4]).</p></dd><dt class="param">appName</dt><dd class="cmt"><p>A name for your application, to display on the cluster web UI</p></dd><dt class="param">sparkHome</dt><dd class="cmt"><p>The SPARK_HOME directory on the slave nodes</p></dd><dt class="param">jarFile</dt><dd class="cmt"><p>JAR file to send to the cluster. This can be a path on the local file system + or an HDFS, HTTP, HTTPS, or FTP URL. +</p></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#this" data-isabs="false"> + <a id="this:JavaSparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">JavaSparkContext</span><span class="params">(<span name="master">master: String</span>, <span name="appName">appName: String</span>)</span> + </span> + </h4> + <p class="shortcomment cmt"></p><div class="fullcomment"><div class="comment cmt"></div><dl class="paramcmts block"><dt class="param">master</dt><dd class="cmt"><p>Cluster URL to connect to (e.g. mesos://host:port, spark://host:port, local[4]).</p></dd><dt class="param">appName</dt><dd class="cmt"><p>A name for your application, to display on the cluster web UI +</p></dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#this" data-isabs="false"> + <a id="this:JavaSparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">JavaSparkContext</span><span class="params">(<span name="sc">sc: <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#accumulable" data-isabs="false"> + <a id="accumulable[T, R](T,AccumulableParam[T, R]):Accumulable[T, R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">accumulable</span><span class="tparams">[<span name="T">T</span>, <span name="R">R</span>]</span><span class="params">(<span name="initialValue">initialValue: T</span>, <span name="param">param: <a name="spark.AccumulableParam" class="extype" href="../../AccumulableParam.html">AccumulableParam</a>[T, R]</span>)</span><span class="result">: <a name="spark.Accumulable" class="extype" href="../../Accumulable.html">Accumulable</a>[T, R]</span> + </span> + </h4> + <p class="shortcomment cmt">Create an <a name="spark.Accumulable" class="extype" href="../../Accumulable.html">Accumulable</a> shared variable of the given type, to which tasks can +"add" values with <code>add</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Create an <a name="spark.Accumulable" class="extype" href="../../Accumulable.html">Accumulable</a> shared variable of the given type, to which tasks can +"add" values with <code>add</code>. Only the master can access the accumuable's <code>value</code>. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#accumulator" data-isabs="false"> + <a id="accumulator[T](T,AccumulatorParam[T]):Accumulator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">accumulator</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="initialValue">initialValue: T</span>, <span name="accumulatorParam">accumulatorParam: <a name="spark.AccumulatorParam" class="extype" href="../../AccumulatorParam.html">AccumulatorParam</a>[T]</span>)</span><span class="result">: <a name="spark.Accumulator" class="extype" href="../../Accumulator.html">Accumulator</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Create an <a name="spark.Accumulator" class="extype" href="../../Accumulator.html">Accumulator</a> variable of a given type, which tasks can "add" values +to using the <code>add</code> method.</p><div class="fullcomment"><div class="comment cmt"><p>Create an <a name="spark.Accumulator" class="extype" href="../../Accumulator.html">Accumulator</a> variable of a given type, which tasks can "add" values +to using the <code>add</code> method. Only the master can access the accumulator's <code>value</code>. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#accumulator" data-isabs="false"> + <a id="accumulator(Double):Accumulator[Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">accumulator</span><span class="params">(<span name="initialValue">initialValue: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.Accumulator" class="extype" href="../../Accumulator.html">Accumulator</a>[<span name="java.lang.Double" class="extype">Double</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Create an <a name="spark.Accumulator" class="extype" href="../../Accumulator.html">Accumulator</a> double variable, which tasks can "add" values +to using the <code>add</code> method.</p><div class="fullcomment"><div class="comment cmt"><p>Create an <a name="spark.Accumulator" class="extype" href="../../Accumulator.html">Accumulator</a> double variable, which tasks can "add" values +to using the <code>add</code> method. Only the master can access the accumulator's <code>value</code>. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#accumulator" data-isabs="false"> + <a id="accumulator(Int):Accumulator[Integer]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">accumulator</span><span class="params">(<span name="initialValue">initialValue: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.Accumulator" class="extype" href="../../Accumulator.html">Accumulator</a>[<span name="java.lang.Integer" class="extype">Integer</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Create an <a name="spark.Accumulator" class="extype" href="../../Accumulator.html">Accumulator</a> integer variable, which tasks can "add" values +to using the <code>add</code> method.</p><div class="fullcomment"><div class="comment cmt"><p>Create an <a name="spark.Accumulator" class="extype" href="../../Accumulator.html">Accumulator</a> integer variable, which tasks can "add" values +to using the <code>add</code> method. Only the master can access the accumulator's <code>value</code>. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#addFile" data-isabs="false"> + <a id="addFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Add a file to be downloaded with this Spark job on every node.</p><div class="fullcomment"><div class="comment cmt"><p>Add a file to be downloaded with this Spark job on every node. +The <code>path</code> passed can be either a local file, a file in HDFS (or other Hadoop-supported +filesystems), or an HTTP, HTTPS or FTP URI. To access the file in Spark jobs, +use <code>SparkFiles.get(path)</code> to find its download location. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#addJar" data-isabs="false"> + <a id="addJar(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addJar</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Adds a JAR dependency for all tasks to be executed on this SparkContext in the future.</p><div class="fullcomment"><div class="comment cmt"><p>Adds a JAR dependency for all tasks to be executed on this SparkContext in the future. +The <code>path</code> passed can be either a local file, a file in HDFS (or other Hadoop-supported +filesystems), or an HTTP, HTTPS or FTP URI. +</p></div></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#broadcast" data-isabs="false"> + <a id="broadcast[T](T):Broadcast[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">broadcast</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="value">value: T</span>)</span><span class="result">: <a name="spark.broadcast.Broadcast" class="extype" href="../../broadcast/Broadcast.html">Broadcast</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Broadcast a read-only variable to the cluster, returning a spark.Broadcast object for +reading it in distributed functions.</p><div class="fullcomment"><div class="comment cmt"><p>Broadcast a read-only variable to the cluster, returning a spark.Broadcast object for +reading it in distributed functions. The variable will be sent to each cluster only once. +</p></div></div> + </li><li visbl="prt" name="spark.api.java.JavaSparkContext#checkpointFile" data-isabs="false"> + <a id="checkpointFile[T](String):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpointFile</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[T]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#clearFiles" data-isabs="false"> + <a id="clearFiles():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearFiles</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Clear the job's list of files added by <code>addFile</code> so that they do not get downloaded to +any new nodes.</p> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#clearJars" data-isabs="false"> + <a id="clearJars():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearJars</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Clear the job's list of JARs added by <code>addJar</code> so that they do not get downloaded to +any new nodes.</p> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#doubleAccumulator" data-isabs="false"> + <a id="doubleAccumulator(Double):Accumulator[Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">doubleAccumulator</span><span class="params">(<span name="initialValue">initialValue: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.Accumulator" class="extype" href="../../Accumulator.html">Accumulator</a>[<span name="java.lang.Double" class="extype">Double</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Create an <a name="spark.Accumulator" class="extype" href="../../Accumulator.html">Accumulator</a> double variable, which tasks can "add" values +to using the <code>add</code> method.</p><div class="fullcomment"><div class="comment cmt"><p>Create an <a name="spark.Accumulator" class="extype" href="../../Accumulator.html">Accumulator</a> double variable, which tasks can "add" values +to using the <code>add</code> method. Only the master can access the accumulator's <code>value</code>. +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#getSparkHome" data-isabs="false"> + <a id="getSparkHome():Option[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getSparkHome</span><span class="params">()</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Get Spark's home location from either a value set through the constructor, +or the spark.</p><div class="fullcomment"><div class="comment cmt"><p>Get Spark's home location from either a value set through the constructor, +or the spark.home Java property, or the SPARK_HOME environment variable +(in that order of preference). If neither of these is set, return None. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#hadoopConfiguration" data-isabs="false"> + <a id="hadoopConfiguration():Configuration"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hadoopConfiguration</span><span class="params">()</span><span class="result">: <span name="org.apache.hadoop.conf.Configuration" class="extype">Configuration</span></span> + </span> + </h4> + <p class="shortcomment cmt">Returns the Hadoop configuration used for the Hadoop code (e.</p><div class="fullcomment"><div class="comment cmt"><p>Returns the Hadoop configuration used for the Hadoop code (e.g. file systems) we reuse. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#hadoopFile" data-isabs="false"> + <a id="hadoopFile[K, V, F<:InputFormat[K, V]](String,Class[F],Class[K],Class[V]):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hadoopFile</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>, <span name="F">F <: <span name="org.apache.hadoop.mapred.InputFormat" class="extype">InputFormat</span>[K, V]</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="inputFormatClass">inputFormatClass: Class[F]</span>, <span name="keyClass">keyClass: Class[K]</span>, <span name="valueClass">valueClass: Class[V]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Get an RDD for a Hadoop file with an arbitrary InputFormat</p> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#hadoopFile" data-isabs="false"> + <a id="hadoopFile[K, V, F<:InputFormat[K, V]](String,Class[F],Class[K],Class[V],Int):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hadoopFile</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>, <span name="F">F <: <span name="org.apache.hadoop.mapred.InputFormat" class="extype">InputFormat</span>[K, V]</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="inputFormatClass">inputFormatClass: Class[F]</span>, <span name="keyClass">keyClass: Class[K]</span>, <span name="valueClass">valueClass: Class[V]</span>, <span name="minSplits">minSplits: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Get an RDD for a Hadoop file with an arbitrary InputFormat</p> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#hadoopRDD" data-isabs="false"> + <a id="hadoopRDD[K, V, F<:InputFormat[K, V]](JobConf,Class[F],Class[K],Class[V]):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hadoopRDD</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>, <span name="F">F <: <span name="org.apache.hadoop.mapred.InputFormat" class="extype">InputFormat</span>[K, V]</span>]</span><span class="params">(<span name="conf">conf: <span name="org.apache.hadoop.mapred.JobConf" class="extype">JobConf</span></span>, <span name="inputFormatClass">inputFormatClass: Class[F]</span>, <span name="keyClass">keyClass: Class[K]</span>, <span name="valueClass">valueClass: Class[V]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Get an RDD for a Hadoop-readable dataset from a Hadooop JobConf giving its InputFormat and any +other necessary info (e.</p><div class="fullcomment"><div class="comment cmt"><p>Get an RDD for a Hadoop-readable dataset from a Hadooop JobConf giving its InputFormat and any +other necessary info (e.g. file name for a filesystem-based dataset, table name for HyperTable, +etc). +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#hadoopRDD" data-isabs="false"> + <a id="hadoopRDD[K, V, F<:InputFormat[K, V]](JobConf,Class[F],Class[K],Class[V],Int):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hadoopRDD</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>, <span name="F">F <: <span name="org.apache.hadoop.mapred.InputFormat" class="extype">InputFormat</span>[K, V]</span>]</span><span class="params">(<span name="conf">conf: <span name="org.apache.hadoop.mapred.JobConf" class="extype">JobConf</span></span>, <span name="inputFormatClass">inputFormatClass: Class[F]</span>, <span name="keyClass">keyClass: Class[K]</span>, <span name="valueClass">valueClass: Class[V]</span>, <span name="minSplits">minSplits: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Get an RDD for a Hadoop-readable dataset from a Hadooop JobConf giving its InputFormat and any +other necessary info (e.</p><div class="fullcomment"><div class="comment cmt"><p>Get an RDD for a Hadoop-readable dataset from a Hadooop JobConf giving its InputFormat and any +other necessary info (e.g. file name for a filesystem-based dataset, table name for HyperTable, +etc). +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#intAccumulator" data-isabs="false"> + <a id="intAccumulator(Int):Accumulator[Integer]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">intAccumulator</span><span class="params">(<span name="initialValue">initialValue: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.Accumulator" class="extype" href="../../Accumulator.html">Accumulator</a>[<span name="java.lang.Integer" class="extype">Integer</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Create an <a name="spark.Accumulator" class="extype" href="../../Accumulator.html">Accumulator</a> integer variable, which tasks can "add" values +to using the <code>add</code> method.</p><div class="fullcomment"><div class="comment cmt"><p>Create an <a name="spark.Accumulator" class="extype" href="../../Accumulator.html">Accumulator</a> integer variable, which tasks can "add" values +to using the <code>add</code> method. Only the master can access the accumulator's <code>value</code>. +</p></div></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#newAPIHadoopFile" data-isabs="false"> + <a id="newAPIHadoopFile[K, V, F<:InputFormat[K, V]](String,Class[F],Class[K],Class[V],Configuration):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">newAPIHadoopFile</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>, <span name="F">F <: <span name="org.apache.hadoop.mapreduce.InputFormat" class="extype">InputFormat</span>[K, V]</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="fClass">fClass: Class[F]</span>, <span name="kClass">kClass: Class[K]</span>, <span name="vClass">vClass: Class[V]</span>, <span name="conf">conf: <span name="org.apache.hadoop.conf.Configuration" class="extype">Configuration</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Get an RDD for a given Hadoop file with an arbitrary new API InputFormat +and extra configuration options to pass to the input format.</p> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#newAPIHadoopRDD" data-isabs="false"> + <a id="newAPIHadoopRDD[K, V, F<:InputFormat[K, V]](Configuration,Class[F],Class[K],Class[V]):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">newAPIHadoopRDD</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>, <span name="F">F <: <span name="org.apache.hadoop.mapreduce.InputFormat" class="extype">InputFormat</span>[K, V]</span>]</span><span class="params">(<span name="conf">conf: <span name="org.apache.hadoop.conf.Configuration" class="extype">Configuration</span></span>, <span name="fClass">fClass: Class[F]</span>, <span name="kClass">kClass: Class[K]</span>, <span name="vClass">vClass: Class[V]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Get an RDD for a given Hadoop file with an arbitrary new API InputFormat +and extra configuration options to pass to the input format.</p> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#objectFile" data-isabs="false"> + <a id="objectFile[T](String):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">objectFile</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Load an RDD saved as a SequenceFile containing serialized objects, with NullWritable keys and +BytesWritable values that contain a serialized partition.</p><div class="fullcomment"><div class="comment cmt"><p>Load an RDD saved as a SequenceFile containing serialized objects, with NullWritable keys and +BytesWritable values that contain a serialized partition. This is still an experimental storage +format and may not be supported exactly as is in future Spark releases. It will also be pretty +slow if you use the default serializer (Java serialization), though the nice thing about it is +that there's very little effort required to save arbitrary objects. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#objectFile" data-isabs="false"> + <a id="objectFile[T](String,Int):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">objectFile</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="minSplits">minSplits: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Load an RDD saved as a SequenceFile containing serialized objects, with NullWritable keys and +BytesWritable values that contain a serialized partition.</p><div class="fullcomment"><div class="comment cmt"><p>Load an RDD saved as a SequenceFile containing serialized objects, with NullWritable keys and +BytesWritable values that contain a serialized partition. This is still an experimental storage +format and may not be supported exactly as is in future Spark releases. It will also be pretty +slow if you use the default serializer (Java serialization), though the nice thing about it is +that there's very little effort required to save arbitrary objects. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#parallelize" data-isabs="false"> + <a id="parallelize[T](List[T]):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">parallelize</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="list">list: <span name="java.util.List" class="extype">List</span>[T]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Distribute a local Scala collection to form an RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#parallelize" data-isabs="false"> + <a id="parallelize[T](List[T],Int):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">parallelize</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="list">list: <span name="java.util.List" class="extype">List</span>[T]</span>, <span name="numSlices">numSlices: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Distribute a local Scala collection to form an RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#parallelizeDoubles" data-isabs="false"> + <a id="parallelizeDoubles(List[Double]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">parallelizeDoubles</span><span class="params">(<span name="list">list: <span name="java.util.List" class="extype">List</span>[<span name="java.lang.Double" class="extype">Double</span>]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Distribute a local Scala collection to form an RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#parallelizeDoubles" data-isabs="false"> + <a id="parallelizeDoubles(List[Double],Int):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">parallelizeDoubles</span><span class="params">(<span name="list">list: <span name="java.util.List" class="extype">List</span>[<span name="java.lang.Double" class="extype">Double</span>]</span>, <span name="numSlices">numSlices: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Distribute a local Scala collection to form an RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#parallelizePairs" data-isabs="false"> + <a id="parallelizePairs[K, V](List[(K, V)]):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">parallelizePairs</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="list">list: <span name="java.util.List" class="extype">List</span>[(K, V)]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Distribute a local Scala collection to form an RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#parallelizePairs" data-isabs="false"> + <a id="parallelizePairs[K, V](List[(K, V)],Int):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">parallelizePairs</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="list">list: <span name="java.util.List" class="extype">List</span>[(K, V)]</span>, <span name="numSlices">numSlices: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Distribute a local Scala collection to form an RDD.</p> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#sc" data-isabs="false"> + <a id="sc:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">sc</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#sequenceFile" data-isabs="false"> + <a id="sequenceFile[K, V](String,Class[K],Class[V]):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sequenceFile</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="keyClass">keyClass: Class[K]</span>, <span name="valueClass">valueClass: Class[V]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Get an RDD for a Hadoop SequenceFile.</p> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#sequenceFile" data-isabs="false"> + <a id="sequenceFile[K, V](String,Class[K],Class[V],Int):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sequenceFile</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="path">path: String</span>, <span name="keyClass">keyClass: Class[K]</span>, <span name="valueClass">valueClass: Class[V]</span>, <span name="minSplits">minSplits: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Get an RDD for a Hadoop SequenceFile with given key and value types.</p> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#setCheckpointDir" data-isabs="false"> + <a id="setCheckpointDir(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setCheckpointDir</span><span class="params">(<span name="dir">dir: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Set the directory under which RDDs are going to be checkpointed.</p><div class="fullcomment"><div class="comment cmt"><p>Set the directory under which RDDs are going to be checkpointed. The directory must +be a HDFS path if running on a cluster. If the directory does not exist, it will +be created. If the directory exists, an exception will be thrown to prevent accidental +overriding of checkpoint files. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#setCheckpointDir" data-isabs="false"> + <a id="setCheckpointDir(String,Boolean):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setCheckpointDir</span><span class="params">(<span name="dir">dir: String</span>, <span name="useExisting">useExisting: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Set the directory under which RDDs are going to be checkpointed.</p><div class="fullcomment"><div class="comment cmt"><p>Set the directory under which RDDs are going to be checkpointed. The directory must +be a HDFS path if running on a cluster. If the directory does not exist, it will +be created. If the directory exists and useExisting is set to true, then the +exisiting directory will be used. Otherwise an exception will be thrown to +prevent accidental overriding of checkpoint files in the existing directory. +</p></div></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#stop" data-isabs="false"> + <a id="stop():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">stop</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Shut down the SparkContext.</p> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#textFile" data-isabs="false"> + <a id="textFile(String,Int):JavaRDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">textFile</span><span class="params">(<span name="path">path: String</span>, <span name="minSplits">minSplits: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Read a text file from HDFS, a local file system (available on all nodes), or any +Hadoop-supported file system URI, and return it as an RDD of Strings.</p> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#textFile" data-isabs="false"> + <a id="textFile(String):JavaRDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">textFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Read a text file from HDFS, a local file system (available on all nodes), or any +Hadoop-supported file system URI, and return it as an RDD of Strings.</p> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#union" data-isabs="false"> + <a id="union(JavaDoubleRDD,List[JavaDoubleRDD]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="first">first: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span>, <span name="rest">rest: <span name="java.util.List" class="extype">List</span>[<a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a>]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span> + </span> + </h4> + <p class="shortcomment cmt">Build the union of two or more RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>Build the union of two or more RDDs.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaSparkContext" class="extype" href="">JavaSparkContext</a> → JavaSparkContextVarargsWorkaround</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#union" data-isabs="false"> + <a id="union[K, V](JavaPairRDD[K, V],List[JavaPairRDD[K, V]]):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="first">first: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]</span>, <span name="rest">rest: <span name="java.util.List" class="extype">List</span>[<a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <p class="shortcomment cmt">Build the union of two or more RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>Build the union of two or more RDDs.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaSparkContext" class="extype" href="">JavaSparkContext</a> → JavaSparkContextVarargsWorkaround</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContext#union" data-isabs="false"> + <a id="union[T](JavaRDD[T],List[JavaRDD[T]]):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="first">first: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[T]</span>, <span name="rest">rest: <span name="java.util.List" class="extype">List</span>[<a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[T]]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Build the union of two or more RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>Build the union of two or more RDDs.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.JavaSparkContext" class="extype" href="">JavaSparkContext</a> → JavaSparkContextVarargsWorkaround</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContextVarargsWorkaround#union" data-isabs="false"> + <a id="union[K, V](<repeated...>[JavaPairRDD[K, V]]):JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="params">(<span name="rdds">rdds: <span name="scala.<repeated...>" class="extype"><repeated...></span>[<a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]]</span>)</span><span class="result">: <a name="spark.api.java.JavaPairRDD" class="extype" href="JavaPairRDD.html">JavaPairRDD</a>[K, V]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>JavaSparkContextVarargsWorkaround</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContextVarargsWorkaround#union" data-isabs="false"> + <a id="union(<repeated...>[JavaDoubleRDD]):JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="rdds">rdds: <span name="scala.<repeated...>" class="extype"><repeated...></span>[<a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a>]</span>)</span><span class="result">: <a name="spark.api.java.JavaDoubleRDD" class="extype" href="JavaDoubleRDD.html">JavaDoubleRDD</a></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>JavaSparkContextVarargsWorkaround</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.JavaSparkContextVarargsWorkaround#union" data-isabs="false"> + <a id="union[T](<repeated...>[JavaRDD[T]]):JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="rdds">rdds: <span name="scala.<repeated...>" class="extype"><repeated...></span>[<a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[T]]</span>)</span><span class="result">: <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>[T]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>JavaSparkContextVarargsWorkaround</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.api.java.JavaSparkContextVarargsWorkaround" class="parent"> + <h3>Inherited from <span name="spark.api.java.JavaSparkContextVarargsWorkaround" class="extype">JavaSparkContextVarargsWorkaround</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/StorageLevels$.html b/site/docs/0.7.0/api/core/spark/api/java/StorageLevels$.html new file mode 100644 index 000000000..fd45bd016 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/StorageLevels$.html @@ -0,0 +1,85 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.StorageLevels</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="StorageLevels.html"><img src="../../../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.api" class="extype" href="../package.html">api</a>.<a name="spark.api.java" class="extype" href="package.html">java</a></p> + <h1><a title="Go to companion" href="StorageLevels.html">StorageLevels</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">StorageLevels</span><span class="result"> extends </span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.api.java.StorageLevels#create" data-isabs="false"> + <a id="create(Boolean,Boolean,Boolean,Int):StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">create</span><span class="params">(<span name="useDisk">useDisk: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="useMemory">useMemory: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="deserialized">deserialized: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="replication">replication: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/StorageLevels.html b/site/docs/0.7.0/api/core/spark/api/java/StorageLevels.html new file mode 100644 index 000000000..1df66d911 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/StorageLevels.html @@ -0,0 +1,370 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.StorageLevels</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="StorageLevels$.html"><img src="../../../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.api" class="extype" href="../package.html">api</a>.<a name="spark.api.java" class="extype" href="package.html">java</a></p> + <h1><a title="Go to companion" href="StorageLevels$.html">StorageLevels</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">StorageLevels</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent">AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.StorageLevels" class="in"><span>StorageLevels</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.api.java.StorageLevels#this" data-isabs="false"> + <a id="this:StorageLevels"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">StorageLevels</span><span class="params">()</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/function/DoubleFlatMapFunction.html b/site/docs/0.7.0/api/core/spark/api/java/function/DoubleFlatMapFunction.html new file mode 100644 index 000000000..4a53c0dbf --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/function/DoubleFlatMapFunction.html @@ -0,0 +1,427 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.function.DoubleFlatMapFunction</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.api" class="extype" href="../../package.html">api</a>.<a name="spark.api.java" class="extype" href="../package.html">java</a>.<a name="spark.api.java.function" class="extype" href="package.html">function</a></p> + <h1>DoubleFlatMapFunction</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">DoubleFlatMapFunction</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <span name="scala.runtime.AbstractFunction1" class="extype">AbstractFunction1</span>[T, <span name="java.lang.Iterable" class="extype">Iterable</span>[<span name="java.lang.Double" class="extype">Double</span>]] with <span name="java.io.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.runtime.AbstractFunction1" class="extype">AbstractFunction1</span>[T, <span name="java.lang.Iterable" class="extype">Iterable</span>[<span name="java.lang.Double" class="extype">Double</span>]], (T) ⇒ <span name="java.lang.Iterable" class="extype">Iterable</span>[<span name="java.lang.Double" class="extype">Double</span>], AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.function.DoubleFlatMapFunction" class="in"><span>DoubleFlatMapFunction</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.runtime.AbstractFunction1" class="in"><span>AbstractFunction1</span></li><li name="scala.Function1" class="in"><span>Function1</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.api.java.function.DoubleFlatMapFunction#this" data-isabs="false"> + <a id="this:DoubleFlatMapFunction[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">DoubleFlatMapFunction</span><span class="params">()</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.api.java.function.DoubleFlatMapFunction#call" data-isabs="true"> + <a id="call(T):Iterable[Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">call</span><span class="params">(<span name="t">t: T</span>)</span><span class="result">: <span name="java.lang.Iterable" class="extype">Iterable</span>[<span name="java.lang.Double" class="extype">Double</span>]</span> + </span> + </h4> + + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Function1#andThen" data-isabs="false"> + <a id="andThen[A]((Iterable[Double]) ⇒ A):(T) ⇒ A"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">andThen</span><span class="tparams">[<span name="A">A</span>]</span><span class="params">(<span name="g">g: (<span name="java.lang.Iterable" class="extype">Iterable</span>[<span name="java.lang.Double" class="extype">Double</span>]) ⇒ A</span>)</span><span class="result">: (T) ⇒ A</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.DoubleFlatMapFunction#apply" data-isabs="false"> + <a id="apply(T):Iterable[Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="t">t: T</span>)</span><span class="result">: <span name="java.lang.Iterable" class="extype">Iterable</span>[<span name="java.lang.Double" class="extype">Double</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.function.DoubleFlatMapFunction" class="extype" href="">DoubleFlatMapFunction</a> → Function1</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.Function1#compose" data-isabs="false"> + <a id="compose[A]((A) ⇒ T):(A) ⇒ Iterable[Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compose</span><span class="tparams">[<span name="A">A</span>]</span><span class="params">(<span name="g">g: (A) ⇒ T</span>)</span><span class="result">: (A) ⇒ <span name="java.lang.Iterable" class="extype">Iterable</span>[<span name="java.lang.Double" class="extype">Double</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Function1#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1 → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.runtime.AbstractFunction1" class="parent"> + <h3>Inherited from <span name="scala.runtime.AbstractFunction1" class="extype">AbstractFunction1</span>[T, <span name="java.lang.Iterable" class="extype">Iterable</span>[<span name="java.lang.Double" class="extype">Double</span>]]</h3> + </div><div name="scala.Function1" class="parent"> + <h3>Inherited from (T) ⇒ <span name="java.lang.Iterable" class="extype">Iterable</span>[<span name="java.lang.Double" class="extype">Double</span>]</h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/function/DoubleFunction.html b/site/docs/0.7.0/api/core/spark/api/java/function/DoubleFunction.html new file mode 100644 index 000000000..35d6ac557 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/function/DoubleFunction.html @@ -0,0 +1,429 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.function.DoubleFunction</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.api" class="extype" href="../../package.html">api</a>.<a name="spark.api.java" class="extype" href="../package.html">java</a>.<a name="spark.api.java.function" class="extype" href="package.html">function</a></p> + <h1>DoubleFunction</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">DoubleFunction</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <span name="spark.api.java.function.WrappedFunction1" class="extype">WrappedFunction1</span>[T, <span name="java.lang.Double" class="extype">Double</span>] with <span name="java.io.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="java.io.Serializable" class="extype">Serializable</span>, <span name="spark.api.java.function.WrappedFunction1" class="extype">WrappedFunction1</span>[T, <span name="java.lang.Double" class="extype">Double</span>], <span name="scala.runtime.AbstractFunction1" class="extype">AbstractFunction1</span>[T, <span name="java.lang.Double" class="extype">Double</span>], (T) ⇒ <span name="java.lang.Double" class="extype">Double</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.function.DoubleFunction" class="in"><span>DoubleFunction</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="spark.api.java.function.WrappedFunction1" class="in"><span>WrappedFunction1</span></li><li name="scala.runtime.AbstractFunction1" class="in"><span>AbstractFunction1</span></li><li name="scala.Function1" class="in"><span>Function1</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.api.java.function.DoubleFunction#this" data-isabs="false"> + <a id="this:DoubleFunction[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">DoubleFunction</span><span class="params">()</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.api.java.function.DoubleFunction#call" data-isabs="true"> + <a id="call(T):Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">call</span><span class="params">(<span name="t">t: T</span>)</span><span class="result">: <span name="java.lang.Double" class="extype">Double</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.function.DoubleFunction" class="extype" href="">DoubleFunction</a> → WrappedFunction1</dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Function1#andThen" data-isabs="false"> + <a id="andThen[A]((Double) ⇒ A):(T) ⇒ A"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">andThen</span><span class="tparams">[<span name="A">A</span>]</span><span class="params">(<span name="g">g: (<span name="java.lang.Double" class="extype">Double</span>) ⇒ A</span>)</span><span class="result">: (T) ⇒ A</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.WrappedFunction1#apply" data-isabs="false"> + <a id="apply(T):Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="t">t: T</span>)</span><span class="result">: <span name="java.lang.Double" class="extype">Double</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>WrappedFunction1 → Function1</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.Function1#compose" data-isabs="false"> + <a id="compose[A]((A) ⇒ T):(A) ⇒ Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compose</span><span class="tparams">[<span name="A">A</span>]</span><span class="params">(<span name="g">g: (A) ⇒ T</span>)</span><span class="result">: (A) ⇒ <span name="java.lang.Double" class="extype">Double</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Function1#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1 → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="spark.api.java.function.WrappedFunction1" class="parent"> + <h3>Inherited from <span name="spark.api.java.function.WrappedFunction1" class="extype">WrappedFunction1</span>[T, <span name="java.lang.Double" class="extype">Double</span>]</h3> + </div><div name="scala.runtime.AbstractFunction1" class="parent"> + <h3>Inherited from <span name="scala.runtime.AbstractFunction1" class="extype">AbstractFunction1</span>[T, <span name="java.lang.Double" class="extype">Double</span>]</h3> + </div><div name="scala.Function1" class="parent"> + <h3>Inherited from (T) ⇒ <span name="java.lang.Double" class="extype">Double</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/function/FlatMapFunction.html b/site/docs/0.7.0/api/core/spark/api/java/function/FlatMapFunction.html new file mode 100644 index 000000000..939c19146 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/function/FlatMapFunction.html @@ -0,0 +1,462 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.function.FlatMapFunction</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.api" class="extype" href="../../package.html">api</a>.<a name="spark.api.java" class="extype" href="../package.html">java</a>.<a name="spark.api.java.function" class="extype" href="package.html">function</a></p> + <h1>FlatMapFunction</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">FlatMapFunction</span><span class="tparams">[<span name="T">T</span>, <span name="R">R</span>]</span><span class="result"> extends <a name="spark.api.java.function.Function" class="extype" href="Function.html">Function</a>[T, <span name="java.lang.Iterable" class="extype">Iterable</span>[R]]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A function that returns zero or more output records from each input record. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.api.java.function.Function" class="extype" href="Function.html">Function</a>[T, <span name="java.lang.Iterable" class="extype">Iterable</span>[R]], <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="spark.api.java.function.WrappedFunction1" class="extype">WrappedFunction1</span>[T, <span name="java.lang.Iterable" class="extype">Iterable</span>[R]], <span name="scala.runtime.AbstractFunction1" class="extype">AbstractFunction1</span>[T, <span name="java.lang.Iterable" class="extype">Iterable</span>[R]], (T) ⇒ <span name="java.lang.Iterable" class="extype">Iterable</span>[R], AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.function.FlatMapFunction" class="in"><span>FlatMapFunction</span></li><li name="spark.api.java.function.Function" class="in"><span>Function</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="spark.api.java.function.WrappedFunction1" class="in"><span>WrappedFunction1</span></li><li name="scala.runtime.AbstractFunction1" class="in"><span>AbstractFunction1</span></li><li name="scala.Function1" class="in"><span>Function1</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.api.java.function.FlatMapFunction#this" data-isabs="false"> + <a id="this:FlatMapFunction[T, R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">FlatMapFunction</span><span class="params">()</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.api.java.function.FlatMapFunction#call" data-isabs="true"> + <a id="call(T):Iterable[R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">call</span><span class="params">(<span name="x">x: T</span>)</span><span class="result">: <span name="java.lang.Iterable" class="extype">Iterable</span>[R]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.function.FlatMapFunction" class="extype" href="">FlatMapFunction</a> → <a name="spark.api.java.function.Function" class="extype" href="Function.html">Function</a> → WrappedFunction1</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">(<span> + + <span class="symbol">classOf[Exception]</span> + </span>)</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Function1#andThen" data-isabs="false"> + <a id="andThen[A]((Iterable[R]) ⇒ A):(T) ⇒ A"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">andThen</span><span class="tparams">[<span name="A">A</span>]</span><span class="params">(<span name="g">g: (<span name="java.lang.Iterable" class="extype">Iterable</span>[R]) ⇒ A</span>)</span><span class="result">: (T) ⇒ A</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.WrappedFunction1#apply" data-isabs="false"> + <a id="apply(T):Iterable[R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="t">t: T</span>)</span><span class="result">: <span name="java.lang.Iterable" class="extype">Iterable</span>[R]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>WrappedFunction1 → Function1</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.Function1#compose" data-isabs="false"> + <a id="compose[A]((A) ⇒ T):(A) ⇒ Iterable[R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compose</span><span class="tparams">[<span name="A">A</span>]</span><span class="params">(<span name="g">g: (A) ⇒ T</span>)</span><span class="result">: (A) ⇒ <span name="java.lang.Iterable" class="extype">Iterable</span>[R]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.FlatMapFunction#elementType" data-isabs="false"> + <a id="elementType():ClassManifest[R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">elementType</span><span class="params">()</span><span class="result">: ClassManifest[R]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.Function#returnType" data-isabs="false"> + <a id="returnType():ClassManifest[Iterable[R]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">returnType</span><span class="params">()</span><span class="result">: <span name="scala.reflect.ClassManifest" class="extype">ClassManifest</span>[<span name="java.lang.Iterable" class="extype">Iterable</span>[R]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.function.Function" class="extype" href="Function.html">Function</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Function1#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1 → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.api.java.function.Function" class="parent"> + <h3>Inherited from <a name="spark.api.java.function.Function" class="extype" href="Function.html">Function</a>[T, <span name="java.lang.Iterable" class="extype">Iterable</span>[R]]</h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="spark.api.java.function.WrappedFunction1" class="parent"> + <h3>Inherited from <span name="spark.api.java.function.WrappedFunction1" class="extype">WrappedFunction1</span>[T, <span name="java.lang.Iterable" class="extype">Iterable</span>[R]]</h3> + </div><div name="scala.runtime.AbstractFunction1" class="parent"> + <h3>Inherited from <span name="scala.runtime.AbstractFunction1" class="extype">AbstractFunction1</span>[T, <span name="java.lang.Iterable" class="extype">Iterable</span>[R]]</h3> + </div><div name="scala.Function1" class="parent"> + <h3>Inherited from (T) ⇒ <span name="java.lang.Iterable" class="extype">Iterable</span>[R]</h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/function/Function.html b/site/docs/0.7.0/api/core/spark/api/java/function/Function.html new file mode 100644 index 000000000..124ddd439 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/function/Function.html @@ -0,0 +1,444 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.function.Function</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.api" class="extype" href="../../package.html">api</a>.<a name="spark.api.java" class="extype" href="../package.html">java</a>.<a name="spark.api.java.function" class="extype" href="package.html">function</a></p> + <h1>Function</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">Function</span><span class="tparams">[<span name="T">T</span>, <span name="R">R</span>]</span><span class="result"> extends <span name="spark.api.java.function.WrappedFunction1" class="extype">WrappedFunction1</span>[T, R] with <span name="java.io.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="java.io.Serializable" class="extype">Serializable</span>, <span name="spark.api.java.function.WrappedFunction1" class="extype">WrappedFunction1</span>[T, R], <span name="scala.runtime.AbstractFunction1" class="extype">AbstractFunction1</span>[T, R], (T) ⇒ R, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div><div class="toggleContainer block"> + <span class="toggle">Known Subclasses</span> + <div class="subClasses hiddenContent"><a name="spark.api.java.function.FlatMapFunction" class="extype" href="FlatMapFunction.html">FlatMapFunction</a></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.function.Function" class="in"><span>Function</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="spark.api.java.function.WrappedFunction1" class="in"><span>WrappedFunction1</span></li><li name="scala.runtime.AbstractFunction1" class="in"><span>AbstractFunction1</span></li><li name="scala.Function1" class="in"><span>Function1</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.api.java.function.Function#this" data-isabs="false"> + <a id="this:Function[T, R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">Function</span><span class="params">()</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.api.java.function.Function#call" data-isabs="true"> + <a id="call(T):R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">call</span><span class="params">(<span name="t">t: T</span>)</span><span class="result">: R</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.function.Function" class="extype" href="">Function</a> → WrappedFunction1</dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Function1#andThen" data-isabs="false"> + <a id="andThen[A]((R) ⇒ A):(T) ⇒ A"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">andThen</span><span class="tparams">[<span name="A">A</span>]</span><span class="params">(<span name="g">g: (R) ⇒ A</span>)</span><span class="result">: (T) ⇒ A</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.WrappedFunction1#apply" data-isabs="false"> + <a id="apply(T):R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="t">t: T</span>)</span><span class="result">: R</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>WrappedFunction1 → Function1</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.Function1#compose" data-isabs="false"> + <a id="compose[A]((A) ⇒ T):(A) ⇒ R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compose</span><span class="tparams">[<span name="A">A</span>]</span><span class="params">(<span name="g">g: (A) ⇒ T</span>)</span><span class="result">: (A) ⇒ R</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.Function#returnType" data-isabs="false"> + <a id="returnType():ClassManifest[R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">returnType</span><span class="params">()</span><span class="result">: <span name="scala.reflect.ClassManifest" class="extype">ClassManifest</span>[R]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Function1#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1 → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="spark.api.java.function.WrappedFunction1" class="parent"> + <h3>Inherited from <span name="spark.api.java.function.WrappedFunction1" class="extype">WrappedFunction1</span>[T, R]</h3> + </div><div name="scala.runtime.AbstractFunction1" class="parent"> + <h3>Inherited from <span name="scala.runtime.AbstractFunction1" class="extype">AbstractFunction1</span>[T, R]</h3> + </div><div name="scala.Function1" class="parent"> + <h3>Inherited from (T) ⇒ R</h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/function/Function2.html b/site/docs/0.7.0/api/core/spark/api/java/function/Function2.html new file mode 100644 index 000000000..69d7af5c9 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/function/Function2.html @@ -0,0 +1,459 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.function.Function2</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.api" class="extype" href="../../package.html">api</a>.<a name="spark.api.java" class="extype" href="../package.html">java</a>.<a name="spark.api.java.function" class="extype" href="package.html">function</a></p> + <h1>Function2</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">Function2</span><span class="tparams">[<span name="T1">T1</span>, <span name="T2">T2</span>, <span name="R">R</span>]</span><span class="result"> extends <span name="spark.api.java.function.WrappedFunction2" class="extype">WrappedFunction2</span>[T1, T2, R] with <span name="java.io.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="java.io.Serializable" class="extype">Serializable</span>, <span name="spark.api.java.function.WrappedFunction2" class="extype">WrappedFunction2</span>[T1, T2, R], <span name="scala.runtime.AbstractFunction2" class="extype">AbstractFunction2</span>[T1, T2, R], (T1, T2) ⇒ R, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.function.Function2" class="in"><span>Function2</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="spark.api.java.function.WrappedFunction2" class="in"><span>WrappedFunction2</span></li><li name="scala.runtime.AbstractFunction2" class="in"><span>AbstractFunction2</span></li><li name="scala.Function2" class="in"><span>Function2</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.api.java.function.Function2#this" data-isabs="false"> + <a id="this:Function2[T1, T2, R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">Function2</span><span class="params">()</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.api.java.function.Function2#call" data-isabs="true"> + <a id="call(T1,T2):R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">call</span><span class="params">(<span name="t1">t1: T1</span>, <span name="t2">t2: T2</span>)</span><span class="result">: R</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.function.Function2" class="extype" href="">Function2</a> → WrappedFunction2</dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.WrappedFunction2#apply" data-isabs="false"> + <a id="apply(T1,T2):R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="t1">t1: T1</span>, <span name="t2">t2: T2</span>)</span><span class="result">: R</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>WrappedFunction2 → Function2</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.Function2#curried" data-isabs="false"> + <a id="curried:(T1) ⇒ (T2) ⇒ R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">curried</span><span class="result">: (T1) ⇒ (T2) ⇒ R</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function2</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.Function2#returnType" data-isabs="false"> + <a id="returnType():ClassManifest[R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">returnType</span><span class="params">()</span><span class="result">: <span name="scala.reflect.ClassManifest" class="extype">ClassManifest</span>[R]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Function2#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function2 → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Function2#tupled" data-isabs="false"> + <a id="tupled:((T1, T2)) ⇒ R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">tupled</span><span class="result">: ((T1, T2)) ⇒ R</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function2</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Function2#curry" data-isabs="false"> + <a id="curry:(T1) ⇒ (T2) ⇒ R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) Use 'curried' instead">curry</span><span class="result">: (T1) ⇒ (T2) ⇒ R</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function2</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> Use 'curried' instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="spark.api.java.function.WrappedFunction2" class="parent"> + <h3>Inherited from <span name="spark.api.java.function.WrappedFunction2" class="extype">WrappedFunction2</span>[T1, T2, R]</h3> + </div><div name="scala.runtime.AbstractFunction2" class="parent"> + <h3>Inherited from <span name="scala.runtime.AbstractFunction2" class="extype">AbstractFunction2</span>[T1, T2, R]</h3> + </div><div name="scala.Function2" class="parent"> + <h3>Inherited from (T1, T2) ⇒ R</h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/function/PairFlatMapFunction.html b/site/docs/0.7.0/api/core/spark/api/java/function/PairFlatMapFunction.html new file mode 100644 index 000000000..72b184f9d --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/function/PairFlatMapFunction.html @@ -0,0 +1,453 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.function.PairFlatMapFunction</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.api" class="extype" href="../../package.html">api</a>.<a name="spark.api.java" class="extype" href="../package.html">java</a>.<a name="spark.api.java.function" class="extype" href="package.html">function</a></p> + <h1>PairFlatMapFunction</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">PairFlatMapFunction</span><span class="tparams">[<span name="T">T</span>, <span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends <span name="spark.api.java.function.WrappedFunction1" class="extype">WrappedFunction1</span>[T, <span name="java.lang.Iterable" class="extype">Iterable</span>[(K, V)]] with <span name="java.io.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="java.io.Serializable" class="extype">Serializable</span>, <span name="spark.api.java.function.WrappedFunction1" class="extype">WrappedFunction1</span>[T, <span name="java.lang.Iterable" class="extype">Iterable</span>[(K, V)]], <span name="scala.runtime.AbstractFunction1" class="extype">AbstractFunction1</span>[T, <span name="java.lang.Iterable" class="extype">Iterable</span>[(K, V)]], (T) ⇒ <span name="java.lang.Iterable" class="extype">Iterable</span>[(K, V)], AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.function.PairFlatMapFunction" class="in"><span>PairFlatMapFunction</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="spark.api.java.function.WrappedFunction1" class="in"><span>WrappedFunction1</span></li><li name="scala.runtime.AbstractFunction1" class="in"><span>AbstractFunction1</span></li><li name="scala.Function1" class="in"><span>Function1</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.api.java.function.PairFlatMapFunction#this" data-isabs="false"> + <a id="this:PairFlatMapFunction[T, K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">PairFlatMapFunction</span><span class="params">()</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.api.java.function.PairFlatMapFunction#call" data-isabs="true"> + <a id="call(T):Iterable[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">call</span><span class="params">(<span name="t">t: T</span>)</span><span class="result">: <span name="java.lang.Iterable" class="extype">Iterable</span>[(K, V)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.function.PairFlatMapFunction" class="extype" href="">PairFlatMapFunction</a> → WrappedFunction1</dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Function1#andThen" data-isabs="false"> + <a id="andThen[A]((Iterable[(K, V)]) ⇒ A):(T) ⇒ A"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">andThen</span><span class="tparams">[<span name="A">A</span>]</span><span class="params">(<span name="g">g: (<span name="java.lang.Iterable" class="extype">Iterable</span>[(K, V)]) ⇒ A</span>)</span><span class="result">: (T) ⇒ A</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.WrappedFunction1#apply" data-isabs="false"> + <a id="apply(T):Iterable[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="t">t: T</span>)</span><span class="result">: <span name="java.lang.Iterable" class="extype">Iterable</span>[(K, V)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>WrappedFunction1 → Function1</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.Function1#compose" data-isabs="false"> + <a id="compose[A]((A) ⇒ T):(A) ⇒ Iterable[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compose</span><span class="tparams">[<span name="A">A</span>]</span><span class="params">(<span name="g">g: (A) ⇒ T</span>)</span><span class="result">: (A) ⇒ <span name="java.lang.Iterable" class="extype">Iterable</span>[(K, V)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.PairFlatMapFunction#keyType" data-isabs="false"> + <a id="keyType():ClassManifest[K]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyType</span><span class="params">()</span><span class="result">: <span name="scala.reflect.ClassManifest" class="extype">ClassManifest</span>[K]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Function1#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1 → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.PairFlatMapFunction#valueType" data-isabs="false"> + <a id="valueType():ClassManifest[V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">valueType</span><span class="params">()</span><span class="result">: <span name="scala.reflect.ClassManifest" class="extype">ClassManifest</span>[V]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="spark.api.java.function.WrappedFunction1" class="parent"> + <h3>Inherited from <span name="spark.api.java.function.WrappedFunction1" class="extype">WrappedFunction1</span>[T, <span name="java.lang.Iterable" class="extype">Iterable</span>[(K, V)]]</h3> + </div><div name="scala.runtime.AbstractFunction1" class="parent"> + <h3>Inherited from <span name="scala.runtime.AbstractFunction1" class="extype">AbstractFunction1</span>[T, <span name="java.lang.Iterable" class="extype">Iterable</span>[(K, V)]]</h3> + </div><div name="scala.Function1" class="parent"> + <h3>Inherited from (T) ⇒ <span name="java.lang.Iterable" class="extype">Iterable</span>[(K, V)]</h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/function/PairFunction.html b/site/docs/0.7.0/api/core/spark/api/java/function/PairFunction.html new file mode 100644 index 000000000..c7540629c --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/function/PairFunction.html @@ -0,0 +1,453 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.function.PairFunction</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.api" class="extype" href="../../package.html">api</a>.<a name="spark.api.java" class="extype" href="../package.html">java</a>.<a name="spark.api.java.function" class="extype" href="package.html">function</a></p> + <h1>PairFunction</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">PairFunction</span><span class="tparams">[<span name="T">T</span>, <span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends <span name="spark.api.java.function.WrappedFunction1" class="extype">WrappedFunction1</span>[T, (K, V)] with <span name="java.io.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="java.io.Serializable" class="extype">Serializable</span>, <span name="spark.api.java.function.WrappedFunction1" class="extype">WrappedFunction1</span>[T, (K, V)], <span name="scala.runtime.AbstractFunction1" class="extype">AbstractFunction1</span>[T, (K, V)], (T) ⇒ (K, V), AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.function.PairFunction" class="in"><span>PairFunction</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="spark.api.java.function.WrappedFunction1" class="in"><span>WrappedFunction1</span></li><li name="scala.runtime.AbstractFunction1" class="in"><span>AbstractFunction1</span></li><li name="scala.Function1" class="in"><span>Function1</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.api.java.function.PairFunction#this" data-isabs="false"> + <a id="this:PairFunction[T, K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">PairFunction</span><span class="params">()</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.api.java.function.PairFunction#call" data-isabs="true"> + <a id="call(T):(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">call</span><span class="params">(<span name="t">t: T</span>)</span><span class="result">: (K, V)</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.java.function.PairFunction" class="extype" href="">PairFunction</a> → WrappedFunction1</dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Function1#andThen" data-isabs="false"> + <a id="andThen[A](((K, V)) ⇒ A):(T) ⇒ A"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">andThen</span><span class="tparams">[<span name="A">A</span>]</span><span class="params">(<span name="g">g: ((K, V)) ⇒ A</span>)</span><span class="result">: (T) ⇒ A</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.WrappedFunction1#apply" data-isabs="false"> + <a id="apply(T):(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="t">t: T</span>)</span><span class="result">: (K, V)</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>WrappedFunction1 → Function1</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.Function1#compose" data-isabs="false"> + <a id="compose[A]((A) ⇒ T):(A) ⇒ (K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compose</span><span class="tparams">[<span name="A">A</span>]</span><span class="params">(<span name="g">g: (A) ⇒ T</span>)</span><span class="result">: (A) ⇒ (K, V)</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.PairFunction#keyType" data-isabs="false"> + <a id="keyType():ClassManifest[K]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyType</span><span class="params">()</span><span class="result">: <span name="scala.reflect.ClassManifest" class="extype">ClassManifest</span>[K]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Function1#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1 → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.PairFunction#valueType" data-isabs="false"> + <a id="valueType():ClassManifest[V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">valueType</span><span class="params">()</span><span class="result">: <span name="scala.reflect.ClassManifest" class="extype">ClassManifest</span>[V]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="spark.api.java.function.WrappedFunction1" class="parent"> + <h3>Inherited from <span name="spark.api.java.function.WrappedFunction1" class="extype">WrappedFunction1</span>[T, (K, V)]</h3> + </div><div name="scala.runtime.AbstractFunction1" class="parent"> + <h3>Inherited from <span name="scala.runtime.AbstractFunction1" class="extype">AbstractFunction1</span>[T, (K, V)]</h3> + </div><div name="scala.Function1" class="parent"> + <h3>Inherited from (T) ⇒ (K, V)</h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/function/VoidFunction$.html b/site/docs/0.7.0/api/core/spark/api/java/function/VoidFunction$.html new file mode 100644 index 000000000..e805ebc07 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/function/VoidFunction$.html @@ -0,0 +1,383 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.function.VoidFunction</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="VoidFunction.html"><img src="../../../../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.api" class="extype" href="../../package.html">api</a>.<a name="spark.api.java" class="extype" href="../package.html">java</a>.<a name="spark.api.java.function" class="extype" href="package.html">function</a></p> + <h1><a title="Go to companion" href="VoidFunction.html">VoidFunction</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">VoidFunction</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.function.VoidFunction" class="in"><span>VoidFunction</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="spark.api.java.function.VoidFunction#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.api.java.function.VoidFunction#toFunction" data-isabs="false"> + <a id="toFunction[T](VoidFunction[T]):(T) ⇒ Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toFunction</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="f">f: <a name="spark.api.java.function.VoidFunction" class="extype" href="VoidFunction.html">VoidFunction</a>[T]</span>)</span><span class="result">: (T) ⇒ <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/function/VoidFunction.html b/site/docs/0.7.0/api/core/spark/api/java/function/VoidFunction.html new file mode 100644 index 000000000..de571bcd6 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/function/VoidFunction.html @@ -0,0 +1,396 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.function.VoidFunction</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="VoidFunction$.html"><img src="../../../../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.api" class="extype" href="../../package.html">api</a>.<a name="spark.api.java" class="extype" href="../package.html">java</a>.<a name="spark.api.java.function" class="extype" href="package.html">function</a></p> + <h1><a title="Go to companion" href="VoidFunction$.html">VoidFunction</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">VoidFunction</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A function with no return value. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.java.function.VoidFunction" class="in"><span>VoidFunction</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.api.java.function.VoidFunction#this" data-isabs="false"> + <a id="this:VoidFunction[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">VoidFunction</span><span class="params">()</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.api.java.function.VoidFunction#call" data-isabs="true"> + <a id="call(T):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">call</span><span class="params">(<span name="t">t: T</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">(<span> + + <span class="symbol">classOf[Exception]</span> + </span>)</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/function/package.html b/site/docs/0.7.0/api/core/spark/api/java/function/package.html new file mode 100644 index 000000000..f17e8a871 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/function/package.html @@ -0,0 +1,184 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java.function</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.api" class="extype" href="../../package.html">api</a>.<a name="spark.api.java" class="extype" href="../package.html">java</a></p> + <h1>function</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">function</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + <div class="types members" id="types"> + <h3>Type Members</h3> + <ol><li visbl="pub" name="spark.api.java.function.DoubleFlatMapFunction" data-isabs="true"> + <a id="DoubleFlatMapFunction:DoubleFlatMapFunction[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="DoubleFlatMapFunction.html"><span class="name">DoubleFlatMapFunction</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends AbstractFunction1[T, Iterable[Double]] with Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.function.DoubleFunction" data-isabs="true"> + <a id="DoubleFunction:DoubleFunction[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="DoubleFunction.html"><span class="name">DoubleFunction</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends WrappedFunction1[T, Double] with Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.function.FlatMapFunction" data-isabs="true"> + <a id="FlatMapFunction:FlatMapFunction[T, R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="FlatMapFunction.html"><span class="name">FlatMapFunction</span></a><span class="tparams">[<span name="T">T</span>, <span name="R">R</span>]</span><span class="result"> extends Function[T, Iterable[R]]</span> + </span> + </h4> + <p class="comment cmt">A function that returns zero or more output records from each input record.</p> + </li><li visbl="pub" name="spark.api.java.function.Function" data-isabs="true"> + <a id="Function:Function[T, R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="Function.html"><span class="name">Function</span></a><span class="tparams">[<span name="T">T</span>, <span name="R">R</span>]</span><span class="result"> extends WrappedFunction1[T, R] with Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.function.Function2" data-isabs="true"> + <a id="Function2:Function2[T1, T2, R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="Function2.html"><span class="name">Function2</span></a><span class="tparams">[<span name="T1">T1</span>, <span name="T2">T2</span>, <span name="R">R</span>]</span><span class="result"> extends WrappedFunction2[T1, T2, R] with Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.function.PairFlatMapFunction" data-isabs="true"> + <a id="PairFlatMapFunction:PairFlatMapFunction[T, K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="PairFlatMapFunction.html"><span class="name">PairFlatMapFunction</span></a><span class="tparams">[<span name="T">T</span>, <span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends WrappedFunction1[T, Iterable[(K, V)]] with Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.function.PairFunction" data-isabs="true"> + <a id="PairFunction:PairFunction[T, K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="PairFunction.html"><span class="name">PairFunction</span></a><span class="tparams">[<span name="T">T</span>, <span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends WrappedFunction1[T, (K, V)] with Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.function.VoidFunction" data-isabs="true"> + <a id="VoidFunction:VoidFunction[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="VoidFunction.html"><span class="name">VoidFunction</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends Serializable</span> + </span> + </h4> + <p class="comment cmt">A function with no return value.</p> + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.api.java.function.VoidFunction" data-isabs="false"> + <a id="VoidFunction:VoidFunction"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="VoidFunction$.html"><span class="name">VoidFunction</span></a><span class="result"> extends Serializable</span> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/java/package.html b/site/docs/0.7.0/api/core/spark/api/java/package.html new file mode 100644 index 000000000..04e3ecdf6 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/java/package.html @@ -0,0 +1,221 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.java</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.api" class="extype" href="../package.html">api</a></p> + <h1>java</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">java</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + <div class="types members" id="types"> + <h3>Type Members</h3> + <ol><li visbl="pub" name="spark.api.java.JavaDoubleRDD" data-isabs="false"> + <a id="JavaDoubleRDD:JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="JavaDoubleRDD.html"><span class="name">JavaDoubleRDD</span></a><span class="result"> extends JavaRDDLike[Double, JavaDoubleRDD]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.JavaPairRDD" data-isabs="false"> + <a id="JavaPairRDD:JavaPairRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="JavaPairRDD.html"><span class="name">JavaPairRDD</span></a><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends JavaRDDLike[(K, V), JavaPairRDD[K, V]]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.JavaRDD" data-isabs="false"> + <a id="JavaRDD:JavaRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="JavaRDD.html"><span class="name">JavaRDD</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends JavaRDDLike[T, JavaRDD[T]]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.JavaRDDLike" data-isabs="true"> + <a id="JavaRDDLike:JavaRDDLike[T, This]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <a href="JavaRDDLike.html"><span class="name">JavaRDDLike</span></a><span class="tparams">[<span name="T">T</span>, <span name="This">This <: JavaRDDLike[T, This]</span>]</span><span class="result"> extends Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.JavaSparkContext" data-isabs="false"> + <a id="JavaSparkContext:JavaSparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="JavaSparkContext.html"><span class="name">JavaSparkContext</span></a><span class="result"> extends JavaSparkContextVarargsWorkaround</span> + </span> + </h4> + <p class="comment cmt">A Java-friendly version of <a name="spark.SparkContext" class="extype" href="../../SparkContext.html">SparkContext</a> that returns <a name="spark.api.java.JavaRDD" class="extype" href="JavaRDD.html">JavaRDD</a>s and +works with Java collections instead of Scala ones.</p> + </li><li visbl="pub" name="spark.api.java.StorageLevels" data-isabs="false"> + <a id="StorageLevels:StorageLevels"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="StorageLevels.html"><span class="name">StorageLevels</span></a><span class="result"> extends AnyRef</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.api.java.JavaDoubleRDD" data-isabs="false"> + <a id="JavaDoubleRDD:JavaDoubleRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="JavaDoubleRDD$.html"><span class="name">JavaDoubleRDD</span></a><span class="result"> extends Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.JavaPairRDD" data-isabs="false"> + <a id="JavaPairRDD:JavaPairRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="JavaPairRDD$.html"><span class="name">JavaPairRDD</span></a><span class="result"> extends Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.JavaRDD" data-isabs="false"> + <a id="JavaRDD:JavaRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="JavaRDD$.html"><span class="name">JavaRDD</span></a><span class="result"> extends Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.JavaSparkContext" data-isabs="false"> + <a id="JavaSparkContext:JavaSparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="JavaSparkContext$.html"><span class="name">JavaSparkContext</span></a><span class="result"> extends AnyRef</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.StorageLevels" data-isabs="false"> + <a id="StorageLevels:StorageLevels"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="StorageLevels$.html"><span class="name">StorageLevels</span></a><span class="result"> extends </span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.java.function" data-isabs="false"> + <a id="function:function"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="function/package.html"><span class="name">function</span></a> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/package.html b/site/docs/0.7.0/api/core/spark/api/package.html new file mode 100644 index 000000000..739b8c7ee --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/package.html @@ -0,0 +1,97 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a></p> + <h1>api</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">api</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.api.java" data-isabs="false"> + <a id="java:java"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="java/package.html"><span class="name">java</span></a> + </span> + </h4> + + </li><li visbl="pub" name="spark.api.python" data-isabs="false"> + <a id="python:python"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="python/package.html"><span class="name">python</span></a> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/python/PythonAccumulatorParam.html b/site/docs/0.7.0/api/core/spark/api/python/PythonAccumulatorParam.html new file mode 100644 index 000000000..7b005bbbf --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/python/PythonAccumulatorParam.html @@ -0,0 +1,422 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.python.PythonAccumulatorParam</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.api" class="extype" href="../package.html">api</a>.<a name="spark.api.python" class="extype" href="package.html">python</a></p> + <h1>PythonAccumulatorParam</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">PythonAccumulatorParam</span><span class="result"> extends <a name="spark.AccumulatorParam" class="extype" href="../../AccumulatorParam.html">AccumulatorParam</a>[<span name="java.util.List" class="extype">List</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]]]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Internal class that acts as an <code>AccumulatorParam</code> for Python accumulators. Inside, it +collects a list of pickled strings that we pass to Python through a socket. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.AccumulatorParam" class="extype" href="../../AccumulatorParam.html">AccumulatorParam</a>[<span name="java.util.List" class="extype">List</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]]], <a name="spark.AccumulableParam" class="extype" href="../../AccumulableParam.html">AccumulableParam</a>[<span name="java.util.List" class="extype">List</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]], <span name="java.util.List" class="extype">List</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]]], <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.api.python.PythonAccumulatorParam" class="in"><span>PythonAccumulatorParam</span></li><li name="spark.AccumulatorParam" class="in"><span>AccumulatorParam</span></li><li name="spark.AccumulableParam" class="in"><span>AccumulableParam</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.api.python.PythonAccumulatorParam#this" data-isabs="false"> + <a id="this:PythonAccumulatorParam"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">PythonAccumulatorParam</span><span class="params">(<span name="serverHost">serverHost: String</span>, <span name="serverPort">serverPort: <span name="scala.Int" class="extype">Int</span></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.AccumulatorParam#addAccumulator" data-isabs="false"> + <a id="addAccumulator(List[Array[Byte]],List[Array[Byte]]):List[Array[Byte]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addAccumulator</span><span class="params">(<span name="t1">t1: <span name="java.util.List" class="extype">List</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]]</span>, <span name="t2">t2: <span name="java.util.List" class="extype">List</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]]</span>)</span><span class="result">: <span name="java.util.List" class="extype">List</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]]</span> + </span> + </h4> + <p class="shortcomment cmt">Add additional data to the accumulator value.</p><div class="fullcomment"><div class="comment cmt"><p>Add additional data to the accumulator value. Is allowed to modify and return <code>r</code> +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt>returns</dt><dd class="cmt"><p>the new value of the accumulator +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.AccumulatorParam" class="extype" href="../../AccumulatorParam.html">AccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="../../AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li><li visbl="pub" name="spark.api.python.PythonAccumulatorParam#addInPlace" data-isabs="false"> + <a id="addInPlace(List[Array[Byte]],List[Array[Byte]]):List[Array[Byte]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addInPlace</span><span class="params">(<span name="val1">val1: <span name="java.util.List" class="extype">List</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]]</span>, <span name="val2">val2: <span name="java.util.List" class="extype">List</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]]</span>)</span><span class="result">: <span name="java.util.List" class="extype">List</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]]</span> + </span> + </h4> + <p class="shortcomment cmt">Merge two accumulated values together.</p><div class="fullcomment"><div class="comment cmt"><p>Merge two accumulated values together. Is allowed to modify and return the first value +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt>returns</dt><dd class="cmt"><p>both data sets merged together +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.python.PythonAccumulatorParam" class="extype" href="">PythonAccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="../../AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.api.python.PythonAccumulatorParam#zero" data-isabs="false"> + <a id="zero(List[Array[Byte]]):List[Array[Byte]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zero</span><span class="params">(<span name="value">value: <span name="java.util.List" class="extype">List</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]]</span>)</span><span class="result">: <span name="java.util.List" class="extype">List</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the "zero" (identity) value for an accumulator type, given its initial value.</p><div class="fullcomment"><div class="comment cmt"><p>Return the "zero" (identity) value for an accumulator type, given its initial value. For +example, if R was a vector of N dimensions, this would return a vector of N zeroes. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.api.python.PythonAccumulatorParam" class="extype" href="">PythonAccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="../../AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.AccumulatorParam" class="parent"> + <h3>Inherited from <a name="spark.AccumulatorParam" class="extype" href="../../AccumulatorParam.html">AccumulatorParam</a>[<span name="java.util.List" class="extype">List</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]]]</h3> + </div><div name="spark.AccumulableParam" class="parent"> + <h3>Inherited from <a name="spark.AccumulableParam" class="extype" href="../../AccumulableParam.html">AccumulableParam</a>[<span name="java.util.List" class="extype">List</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]], <span name="java.util.List" class="extype">List</span>[<span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]]]</h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/api/python/package.html b/site/docs/0.7.0/api/core/spark/api/python/package.html new file mode 100644 index 000000000..7628427d0 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/api/python/package.html @@ -0,0 +1,85 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.api.python</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.api" class="extype" href="../package.html">api</a></p> + <h1>python</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">python</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + <div class="types members" id="types"> + <h3>Type Members</h3> + <ol><li visbl="pub" name="spark.api.python.PythonAccumulatorParam" data-isabs="false"> + <a id="PythonAccumulatorParam:PythonAccumulatorParam"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="PythonAccumulatorParam.html"><span class="name">PythonAccumulatorParam</span></a><span class="result"> extends AccumulatorParam[List[Array[Byte]]]</span> + </span> + </h4> + <p class="comment cmt">Internal class that acts as an <code>AccumulatorParam</code> for Python accumulators.</p> + </li></ol> + </div> + + + + + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/broadcast/Broadcast.html b/site/docs/0.7.0/api/core/spark/broadcast/Broadcast.html new file mode 100644 index 000000000..36a0a19d3 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/broadcast/Broadcast.html @@ -0,0 +1,387 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.broadcast.Broadcast</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.broadcast" class="extype" href="package.html">broadcast</a></p> + <h1>Broadcast</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">Broadcast</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <span name="java.io.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.broadcast.Broadcast" class="in"><span>Broadcast</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.broadcast.Broadcast#this" data-isabs="false"> + <a id="this:Broadcast[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">Broadcast</span><span class="params">(<span name="id">id: <span name="scala.Long" class="extype">Long</span></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.broadcast.Broadcast#value" data-isabs="true"> + <a id="value:T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">value</span><span class="result">: T</span> + </span> + </h4> + + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.broadcast.Broadcast#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.broadcast.Broadcast" class="extype" href="">Broadcast</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/broadcast/package.html b/site/docs/0.7.0/api/core/spark/broadcast/package.html new file mode 100644 index 000000000..2864abe49 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/broadcast/package.html @@ -0,0 +1,85 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.broadcast</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a></p> + <h1>broadcast</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">broadcast</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + <div class="types members" id="types"> + <h3>Type Members</h3> + <ol><li visbl="pub" name="spark.broadcast.Broadcast" data-isabs="true"> + <a id="Broadcast:Broadcast[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="Broadcast.html"><span class="name">Broadcast</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends Serializable</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/common/html/layout$.html b/site/docs/0.7.0/api/core/spark/common/html/layout$.html new file mode 100644 index 000000000..5c7d33797 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/common/html/layout$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.common.html.layout</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.common" class="extype" href="../package.html">common</a>.<a name="spark.common.html" class="extype" href="package.html">html</a></p> + <h1>layout</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">layout</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template2" class="extype">Template2</span>[String, <span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template2" class="extype">Template2</span>[String, <span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.common.html.layout" class="in"><span>layout</span></li><li name="twirl.api.Template2" class="in"><span>Template2</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.common.html.layout#apply" data-isabs="false"> + <a id="apply(String)(Html):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="title">title: String</span>)</span><span class="params">(<span name="content">content: <span name="twirl.api.Html" class="extype">Html</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.common.html.layout#f" data-isabs="false"> + <a id="f:(String) ⇒ (Html) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (String) ⇒ (<span name="twirl.api.Html" class="extype">Html</span>) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.common.html.layout#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.common.html.layout#ref" data-isabs="false"> + <a id="ref:spark.common.html.layout.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.common.html.layout.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.common.html.layout#render" data-isabs="false"> + <a id="render(String,Html):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="title">title: String</span>, <span name="content">content: <span name="twirl.api.Html" class="extype">Html</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.common.html.layout" class="extype" href="">layout</a> → Template2</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template2" class="parent"> + <h3>Inherited from <span name="twirl.api.Template2" class="extype">Template2</span>[String, <span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/common/html/package.html b/site/docs/0.7.0/api/core/spark/common/html/package.html new file mode 100644 index 000000000..4e0921637 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/common/html/package.html @@ -0,0 +1,85 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.common.html</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.common" class="extype" href="../package.html">common</a></p> + <h1>html</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">html</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.common.html.layout" data-isabs="false"> + <a id="layout:layout"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="layout$.html"><span class="name">layout</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template2[String, Html, Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/common/package.html b/site/docs/0.7.0/api/core/spark/common/package.html new file mode 100644 index 000000000..275594529 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/common/package.html @@ -0,0 +1,85 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.common</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a></p> + <h1>common</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">common</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.common.html" data-isabs="false"> + <a id="html:html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="html/package.html"><span class="name">html</span></a> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/common/html/layout$.html b/site/docs/0.7.0/api/core/spark/deploy/common/html/layout$.html new file mode 100644 index 000000000..1e1ce5ab7 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/common/html/layout$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.common.html.layout</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.common" class="extype" href="../package.html">common</a>.<a name="spark.deploy.common.html" class="extype" href="package.html">html</a></p> + <h1>layout</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">layout</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template2" class="extype">Template2</span>[String, <span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template2" class="extype">Template2</span>[String, <span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.deploy.common.html.layout" class="in"><span>layout</span></li><li name="twirl.api.Template2" class="in"><span>Template2</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.common.html.layout#apply" data-isabs="false"> + <a id="apply(String)(Html):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="title">title: String</span>)</span><span class="params">(<span name="content">content: <span name="twirl.api.Html" class="extype">Html</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.common.html.layout#f" data-isabs="false"> + <a id="f:(String) ⇒ (Html) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (String) ⇒ (<span name="twirl.api.Html" class="extype">Html</span>) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.deploy.common.html.layout#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.deploy.common.html.layout#ref" data-isabs="false"> + <a id="ref:spark.deploy.common.html.layout.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.deploy.common.html.layout.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.common.html.layout#render" data-isabs="false"> + <a id="render(String,Html):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="title">title: String</span>, <span name="content">content: <span name="twirl.api.Html" class="extype">Html</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.deploy.common.html.layout" class="extype" href="">layout</a> → Template2</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template2" class="parent"> + <h3>Inherited from <span name="twirl.api.Template2" class="extype">Template2</span>[String, <span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/common/html/package.html b/site/docs/0.7.0/api/core/spark/deploy/common/html/package.html new file mode 100644 index 000000000..854f2909b --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/common/html/package.html @@ -0,0 +1,85 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.common.html</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.common" class="extype" href="../package.html">common</a></p> + <h1>html</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">html</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.deploy.common.html.layout" data-isabs="false"> + <a id="layout:layout"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="layout$.html"><span class="name">layout</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template2[String, Html, Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/common/package.html b/site/docs/0.7.0/api/core/spark/deploy/common/package.html new file mode 100644 index 000000000..2280a6d52 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/common/package.html @@ -0,0 +1,85 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.common</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../package.html">deploy</a></p> + <h1>common</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">common</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.deploy.common.html" data-isabs="false"> + <a id="html:html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="html/package.html"><span class="name">html</span></a> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/master/html/app_details$.html b/site/docs/0.7.0/api/core/spark/deploy/master/html/app_details$.html new file mode 100644 index 000000000..59e42c130 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/master/html/app_details$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.master.html.app_details</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.master" class="extype" href="../package.html">master</a>.<a name="spark.deploy.master.html" class="extype" href="package.html">html</a></p> + <h1>app_details</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">app_details</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.deploy.master.html.app_details" class="in"><span>app_details</span></li><li name="twirl.api.Template1" class="in"><span>Template1</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.app_details#apply" data-isabs="false"> + <a id="apply(ApplicationInfo):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="app">app: <span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.app_details#f" data-isabs="false"> + <a id="f:(ApplicationInfo) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (<span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span>) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.deploy.master.html.app_details#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.app_details#ref" data-isabs="false"> + <a id="ref:spark.deploy.master.html.app_details.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.deploy.master.html.app_details.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.master.html.app_details#render" data-isabs="false"> + <a id="render(ApplicationInfo):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="app">app: <span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.deploy.master.html.app_details" class="extype" href="">app_details</a> → Template1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template1" class="parent"> + <h3>Inherited from <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/master/html/app_row$.html b/site/docs/0.7.0/api/core/spark/deploy/master/html/app_row$.html new file mode 100644 index 000000000..861a5d48c --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/master/html/app_row$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.master.html.app_row</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.master" class="extype" href="../package.html">master</a>.<a name="spark.deploy.master.html" class="extype" href="package.html">html</a></p> + <h1>app_row</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">app_row</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.deploy.master.html.app_row" class="in"><span>app_row</span></li><li name="twirl.api.Template1" class="in"><span>Template1</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.app_row#apply" data-isabs="false"> + <a id="apply(ApplicationInfo):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="app">app: <span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.app_row#f" data-isabs="false"> + <a id="f:(ApplicationInfo) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (<span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span>) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.deploy.master.html.app_row#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.app_row#ref" data-isabs="false"> + <a id="ref:spark.deploy.master.html.app_row.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.deploy.master.html.app_row.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.master.html.app_row#render" data-isabs="false"> + <a id="render(ApplicationInfo):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="app">app: <span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.deploy.master.html.app_row" class="extype" href="">app_row</a> → Template1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template1" class="parent"> + <h3>Inherited from <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/master/html/app_table$.html b/site/docs/0.7.0/api/core/spark/deploy/master/html/app_table$.html new file mode 100644 index 000000000..b9c5a5835 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/master/html/app_table$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.master.html.app_table</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.master" class="extype" href="../package.html">master</a>.<a name="spark.deploy.master.html" class="extype" href="package.html">html</a></p> + <h1>app_table</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">app_table</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="scala.Array" class="extype">Array</span>[<span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span>], <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template1" class="extype">Template1</span>[<span name="scala.Array" class="extype">Array</span>[<span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span>], <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.deploy.master.html.app_table" class="in"><span>app_table</span></li><li name="twirl.api.Template1" class="in"><span>Template1</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.app_table#apply" data-isabs="false"> + <a id="apply(Array[ApplicationInfo]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="apps">apps: <span name="scala.Array" class="extype">Array</span>[<span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.app_table#f" data-isabs="false"> + <a id="f:(Array[ApplicationInfo]) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (<span name="scala.Array" class="extype">Array</span>[<span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span>]) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.deploy.master.html.app_table#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.app_table#ref" data-isabs="false"> + <a id="ref:spark.deploy.master.html.app_table.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.deploy.master.html.app_table.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.master.html.app_table#render" data-isabs="false"> + <a id="render(Array[ApplicationInfo]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="apps">apps: <span name="scala.Array" class="extype">Array</span>[<span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.deploy.master.html.app_table" class="extype" href="">app_table</a> → Template1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template1" class="parent"> + <h3>Inherited from <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="scala.Array" class="extype">Array</span>[<span name="spark.deploy.master.ApplicationInfo" class="extype">ApplicationInfo</span>], <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/master/html/executor_row$.html b/site/docs/0.7.0/api/core/spark/deploy/master/html/executor_row$.html new file mode 100644 index 000000000..743e96ef1 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/master/html/executor_row$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.master.html.executor_row</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.master" class="extype" href="../package.html">master</a>.<a name="spark.deploy.master.html" class="extype" href="package.html">html</a></p> + <h1>executor_row</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">executor_row</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.ExecutorInfo" class="extype">ExecutorInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.ExecutorInfo" class="extype">ExecutorInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.deploy.master.html.executor_row" class="in"><span>executor_row</span></li><li name="twirl.api.Template1" class="in"><span>Template1</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.executor_row#apply" data-isabs="false"> + <a id="apply(ExecutorInfo):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="executor">executor: <span name="spark.deploy.master.ExecutorInfo" class="extype">ExecutorInfo</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.executor_row#f" data-isabs="false"> + <a id="f:(ExecutorInfo) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (<span name="spark.deploy.master.ExecutorInfo" class="extype">ExecutorInfo</span>) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.deploy.master.html.executor_row#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.executor_row#ref" data-isabs="false"> + <a id="ref:spark.deploy.master.html.executor_row.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.deploy.master.html.executor_row.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.master.html.executor_row#render" data-isabs="false"> + <a id="render(ExecutorInfo):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="executor">executor: <span name="spark.deploy.master.ExecutorInfo" class="extype">ExecutorInfo</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.deploy.master.html.executor_row" class="extype" href="">executor_row</a> → Template1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template1" class="parent"> + <h3>Inherited from <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.ExecutorInfo" class="extype">ExecutorInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/master/html/executors_table$.html b/site/docs/0.7.0/api/core/spark/deploy/master/html/executors_table$.html new file mode 100644 index 000000000..70bf7cbcc --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/master/html/executors_table$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.master.html.executors_table</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.master" class="extype" href="../package.html">master</a>.<a name="spark.deploy.master.html" class="extype" href="package.html">html</a></p> + <h1>executors_table</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">executors_table</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template1" class="extype">Template1</span>[List[<span name="spark.deploy.master.ExecutorInfo" class="extype">ExecutorInfo</span>], <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template1" class="extype">Template1</span>[List[<span name="spark.deploy.master.ExecutorInfo" class="extype">ExecutorInfo</span>], <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.deploy.master.html.executors_table" class="in"><span>executors_table</span></li><li name="twirl.api.Template1" class="in"><span>Template1</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.executors_table#apply" data-isabs="false"> + <a id="apply(List[ExecutorInfo]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="executors">executors: List[<span name="spark.deploy.master.ExecutorInfo" class="extype">ExecutorInfo</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.executors_table#f" data-isabs="false"> + <a id="f:(List[ExecutorInfo]) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (List[<span name="spark.deploy.master.ExecutorInfo" class="extype">ExecutorInfo</span>]) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.deploy.master.html.executors_table#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.executors_table#ref" data-isabs="false"> + <a id="ref:spark.deploy.master.html.executors_table.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.deploy.master.html.executors_table.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.master.html.executors_table#render" data-isabs="false"> + <a id="render(List[ExecutorInfo]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="executors">executors: List[<span name="spark.deploy.master.ExecutorInfo" class="extype">ExecutorInfo</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.deploy.master.html.executors_table" class="extype" href="">executors_table</a> → Template1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template1" class="parent"> + <h3>Inherited from <span name="twirl.api.Template1" class="extype">Template1</span>[List[<span name="spark.deploy.master.ExecutorInfo" class="extype">ExecutorInfo</span>], <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/master/html/index$.html b/site/docs/0.7.0/api/core/spark/deploy/master/html/index$.html new file mode 100644 index 000000000..dcb327ac6 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/master/html/index$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.master.html.index</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.master" class="extype" href="../package.html">master</a>.<a name="spark.deploy.master.html" class="extype" href="package.html">html</a></p> + <h1>index</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">index</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.MasterState" class="extype">MasterState</span>, <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.MasterState" class="extype">MasterState</span>, <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.deploy.master.html.index" class="in"><span>index</span></li><li name="twirl.api.Template1" class="in"><span>Template1</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.index#apply" data-isabs="false"> + <a id="apply(MasterState):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="state">state: <span name="spark.deploy.MasterState" class="extype">MasterState</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.index#f" data-isabs="false"> + <a id="f:(MasterState) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (<span name="spark.deploy.MasterState" class="extype">MasterState</span>) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.deploy.master.html.index#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.index#ref" data-isabs="false"> + <a id="ref:spark.deploy.master.html.index.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.deploy.master.html.index.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.master.html.index#render" data-isabs="false"> + <a id="render(MasterState):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="state">state: <span name="spark.deploy.MasterState" class="extype">MasterState</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.deploy.master.html.index" class="extype" href="">index</a> → Template1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template1" class="parent"> + <h3>Inherited from <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.MasterState" class="extype">MasterState</span>, <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/master/html/job_details$.html b/site/docs/0.7.0/api/core/spark/deploy/master/html/job_details$.html new file mode 100644 index 000000000..78a35a2b7 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/master/html/job_details$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.master.html.job_details</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.master" class="extype" href="../package.html">master</a>.<a name="spark.deploy.master.html" class="extype" href="package.html">html</a></p> + <h1>job_details</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">job_details</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.deploy.master.html.job_details" class="in"><span>job_details</span></li><li name="twirl.api.Template1" class="in"><span>Template1</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.job_details#apply" data-isabs="false"> + <a id="apply(JobInfo):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="job">job: <span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.job_details#f" data-isabs="false"> + <a id="f:(JobInfo) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (<span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span>) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.deploy.master.html.job_details#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.job_details#ref" data-isabs="false"> + <a id="ref:spark.deploy.master.html.job_details.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.deploy.master.html.job_details.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.master.html.job_details#render" data-isabs="false"> + <a id="render(JobInfo):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="job">job: <span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.deploy.master.html.job_details" class="extype" href="">job_details</a> → Template1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template1" class="parent"> + <h3>Inherited from <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/master/html/job_row$.html b/site/docs/0.7.0/api/core/spark/deploy/master/html/job_row$.html new file mode 100644 index 000000000..427b35e05 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/master/html/job_row$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.master.html.job_row</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.master" class="extype" href="../package.html">master</a>.<a name="spark.deploy.master.html" class="extype" href="package.html">html</a></p> + <h1>job_row</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">job_row</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.deploy.master.html.job_row" class="in"><span>job_row</span></li><li name="twirl.api.Template1" class="in"><span>Template1</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.job_row#apply" data-isabs="false"> + <a id="apply(JobInfo):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="job">job: <span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.job_row#f" data-isabs="false"> + <a id="f:(JobInfo) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (<span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span>) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.deploy.master.html.job_row#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.job_row#ref" data-isabs="false"> + <a id="ref:spark.deploy.master.html.job_row.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.deploy.master.html.job_row.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.master.html.job_row#render" data-isabs="false"> + <a id="render(JobInfo):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="job">job: <span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.deploy.master.html.job_row" class="extype" href="">job_row</a> → Template1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template1" class="parent"> + <h3>Inherited from <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/master/html/job_table$.html b/site/docs/0.7.0/api/core/spark/deploy/master/html/job_table$.html new file mode 100644 index 000000000..45f8f28f4 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/master/html/job_table$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.master.html.job_table</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.master" class="extype" href="../package.html">master</a>.<a name="spark.deploy.master.html" class="extype" href="package.html">html</a></p> + <h1>job_table</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">job_table</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template1" class="extype">Template1</span>[List[<span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span>], <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template1" class="extype">Template1</span>[List[<span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span>], <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.deploy.master.html.job_table" class="in"><span>job_table</span></li><li name="twirl.api.Template1" class="in"><span>Template1</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.job_table#apply" data-isabs="false"> + <a id="apply(List[JobInfo]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="jobs">jobs: List[<span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.job_table#f" data-isabs="false"> + <a id="f:(List[JobInfo]) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (List[<span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span>]) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.deploy.master.html.job_table#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.job_table#ref" data-isabs="false"> + <a id="ref:spark.deploy.master.html.job_table.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.deploy.master.html.job_table.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.master.html.job_table#render" data-isabs="false"> + <a id="render(List[JobInfo]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="jobs">jobs: List[<span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.deploy.master.html.job_table" class="extype" href="">job_table</a> → Template1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template1" class="parent"> + <h3>Inherited from <span name="twirl.api.Template1" class="extype">Template1</span>[List[<span name="spark.deploy.master.JobInfo" class="extype">JobInfo</span>], <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/master/html/package.html b/site/docs/0.7.0/api/core/spark/deploy/master/html/package.html new file mode 100644 index 000000000..1e4f46f88 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/master/html/package.html @@ -0,0 +1,169 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.master.html</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.master" class="extype" href="../package.html">master</a></p> + <h1>html</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">html</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.deploy.master.html.app_details" data-isabs="false"> + <a id="app_details:app_details"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="app_details$.html"><span class="name">app_details</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template1[ApplicationInfo, Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li><li visbl="pub" name="spark.deploy.master.html.app_row" data-isabs="false"> + <a id="app_row:app_row"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="app_row$.html"><span class="name">app_row</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template1[ApplicationInfo, Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li><li visbl="pub" name="spark.deploy.master.html.app_table" data-isabs="false"> + <a id="app_table:app_table"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="app_table$.html"><span class="name">app_table</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template1[Array[ApplicationInfo], Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li><li visbl="pub" name="spark.deploy.master.html.executor_row" data-isabs="false"> + <a id="executor_row:executor_row"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="executor_row$.html"><span class="name">executor_row</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template1[ExecutorInfo, Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li><li visbl="pub" name="spark.deploy.master.html.executors_table" data-isabs="false"> + <a id="executors_table:executors_table"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="executors_table$.html"><span class="name">executors_table</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template1[List[ExecutorInfo], Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li><li visbl="pub" name="spark.deploy.master.html.index" data-isabs="false"> + <a id="index:index"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="index$.html"><span class="name">index</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template1[MasterState, Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li><li visbl="pub" name="spark.deploy.master.html.worker_row" data-isabs="false"> + <a id="worker_row:worker_row"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="worker_row$.html"><span class="name">worker_row</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template1[WorkerInfo, Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li><li visbl="pub" name="spark.deploy.master.html.worker_table" data-isabs="false"> + <a id="worker_table:worker_table"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="worker_table$.html"><span class="name">worker_table</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template1[Array[WorkerInfo], Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/master/html/worker_row$.html b/site/docs/0.7.0/api/core/spark/deploy/master/html/worker_row$.html new file mode 100644 index 000000000..ee5482d78 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/master/html/worker_row$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.master.html.worker_row</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.master" class="extype" href="../package.html">master</a>.<a name="spark.deploy.master.html" class="extype" href="package.html">html</a></p> + <h1>worker_row</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">worker_row</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.WorkerInfo" class="extype">WorkerInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.WorkerInfo" class="extype">WorkerInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.deploy.master.html.worker_row" class="in"><span>worker_row</span></li><li name="twirl.api.Template1" class="in"><span>Template1</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.worker_row#apply" data-isabs="false"> + <a id="apply(WorkerInfo):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="worker">worker: <span name="spark.deploy.master.WorkerInfo" class="extype">WorkerInfo</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.worker_row#f" data-isabs="false"> + <a id="f:(WorkerInfo) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (<span name="spark.deploy.master.WorkerInfo" class="extype">WorkerInfo</span>) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.deploy.master.html.worker_row#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.worker_row#ref" data-isabs="false"> + <a id="ref:spark.deploy.master.html.worker_row.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.deploy.master.html.worker_row.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.master.html.worker_row#render" data-isabs="false"> + <a id="render(WorkerInfo):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="worker">worker: <span name="spark.deploy.master.WorkerInfo" class="extype">WorkerInfo</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.deploy.master.html.worker_row" class="extype" href="">worker_row</a> → Template1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template1" class="parent"> + <h3>Inherited from <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.master.WorkerInfo" class="extype">WorkerInfo</span>, <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/master/html/worker_table$.html b/site/docs/0.7.0/api/core/spark/deploy/master/html/worker_table$.html new file mode 100644 index 000000000..f26db2584 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/master/html/worker_table$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.master.html.worker_table</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.master" class="extype" href="../package.html">master</a>.<a name="spark.deploy.master.html" class="extype" href="package.html">html</a></p> + <h1>worker_table</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">worker_table</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="scala.Array" class="extype">Array</span>[<span name="spark.deploy.master.WorkerInfo" class="extype">WorkerInfo</span>], <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template1" class="extype">Template1</span>[<span name="scala.Array" class="extype">Array</span>[<span name="spark.deploy.master.WorkerInfo" class="extype">WorkerInfo</span>], <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.deploy.master.html.worker_table" class="in"><span>worker_table</span></li><li name="twirl.api.Template1" class="in"><span>Template1</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.worker_table#apply" data-isabs="false"> + <a id="apply(Array[WorkerInfo]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="workers">workers: <span name="scala.Array" class="extype">Array</span>[<span name="spark.deploy.master.WorkerInfo" class="extype">WorkerInfo</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.worker_table#f" data-isabs="false"> + <a id="f:(Array[WorkerInfo]) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (<span name="scala.Array" class="extype">Array</span>[<span name="spark.deploy.master.WorkerInfo" class="extype">WorkerInfo</span>]) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.deploy.master.html.worker_table#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.deploy.master.html.worker_table#ref" data-isabs="false"> + <a id="ref:spark.deploy.master.html.worker_table.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.deploy.master.html.worker_table.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.master.html.worker_table#render" data-isabs="false"> + <a id="render(Array[WorkerInfo]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="workers">workers: <span name="scala.Array" class="extype">Array</span>[<span name="spark.deploy.master.WorkerInfo" class="extype">WorkerInfo</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.deploy.master.html.worker_table" class="extype" href="">worker_table</a> → Template1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template1" class="parent"> + <h3>Inherited from <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="scala.Array" class="extype">Array</span>[<span name="spark.deploy.master.WorkerInfo" class="extype">WorkerInfo</span>], <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/master/package.html b/site/docs/0.7.0/api/core/spark/deploy/master/package.html new file mode 100644 index 000000000..f8a84a572 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/master/package.html @@ -0,0 +1,85 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.master</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../package.html">deploy</a></p> + <h1>master</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">master</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.deploy.master.html" data-isabs="false"> + <a id="html:html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="html/package.html"><span class="name">html</span></a> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/package.html b/site/docs/0.7.0/api/core/spark/deploy/package.html new file mode 100644 index 000000000..bca66ea53 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/package.html @@ -0,0 +1,97 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a></p> + <h1>deploy</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">deploy</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.deploy.master" data-isabs="false"> + <a id="master:master"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="master/package.html"><span class="name">master</span></a> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.worker" data-isabs="false"> + <a id="worker:worker"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="worker/package.html"><span class="name">worker</span></a> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/worker/html/executor_row$.html b/site/docs/0.7.0/api/core/spark/deploy/worker/html/executor_row$.html new file mode 100644 index 000000000..3355a5977 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/worker/html/executor_row$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.worker.html.executor_row</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.worker" class="extype" href="../package.html">worker</a>.<a name="spark.deploy.worker.html" class="extype" href="package.html">html</a></p> + <h1>executor_row</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">executor_row</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.worker.ExecutorRunner" class="extype">ExecutorRunner</span>, <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.worker.ExecutorRunner" class="extype">ExecutorRunner</span>, <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.deploy.worker.html.executor_row" class="in"><span>executor_row</span></li><li name="twirl.api.Template1" class="in"><span>Template1</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.worker.html.executor_row#apply" data-isabs="false"> + <a id="apply(ExecutorRunner):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="executor">executor: <span name="spark.deploy.worker.ExecutorRunner" class="extype">ExecutorRunner</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.worker.html.executor_row#f" data-isabs="false"> + <a id="f:(ExecutorRunner) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (<span name="spark.deploy.worker.ExecutorRunner" class="extype">ExecutorRunner</span>) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.deploy.worker.html.executor_row#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.deploy.worker.html.executor_row#ref" data-isabs="false"> + <a id="ref:spark.deploy.worker.html.executor_row.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.deploy.worker.html.executor_row.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.worker.html.executor_row#render" data-isabs="false"> + <a id="render(ExecutorRunner):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="executor">executor: <span name="spark.deploy.worker.ExecutorRunner" class="extype">ExecutorRunner</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.deploy.worker.html.executor_row" class="extype" href="">executor_row</a> → Template1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template1" class="parent"> + <h3>Inherited from <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.worker.ExecutorRunner" class="extype">ExecutorRunner</span>, <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/worker/html/executors_table$.html b/site/docs/0.7.0/api/core/spark/deploy/worker/html/executors_table$.html new file mode 100644 index 000000000..924002c45 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/worker/html/executors_table$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.worker.html.executors_table</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.worker" class="extype" href="../package.html">worker</a>.<a name="spark.deploy.worker.html" class="extype" href="package.html">html</a></p> + <h1>executors_table</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">executors_table</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template1" class="extype">Template1</span>[List[<span name="spark.deploy.worker.ExecutorRunner" class="extype">ExecutorRunner</span>], <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template1" class="extype">Template1</span>[List[<span name="spark.deploy.worker.ExecutorRunner" class="extype">ExecutorRunner</span>], <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.deploy.worker.html.executors_table" class="in"><span>executors_table</span></li><li name="twirl.api.Template1" class="in"><span>Template1</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.worker.html.executors_table#apply" data-isabs="false"> + <a id="apply(List[ExecutorRunner]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="executors">executors: List[<span name="spark.deploy.worker.ExecutorRunner" class="extype">ExecutorRunner</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.worker.html.executors_table#f" data-isabs="false"> + <a id="f:(List[ExecutorRunner]) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (List[<span name="spark.deploy.worker.ExecutorRunner" class="extype">ExecutorRunner</span>]) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.deploy.worker.html.executors_table#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.deploy.worker.html.executors_table#ref" data-isabs="false"> + <a id="ref:spark.deploy.worker.html.executors_table.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.deploy.worker.html.executors_table.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.worker.html.executors_table#render" data-isabs="false"> + <a id="render(List[ExecutorRunner]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="executors">executors: List[<span name="spark.deploy.worker.ExecutorRunner" class="extype">ExecutorRunner</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.deploy.worker.html.executors_table" class="extype" href="">executors_table</a> → Template1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template1" class="parent"> + <h3>Inherited from <span name="twirl.api.Template1" class="extype">Template1</span>[List[<span name="spark.deploy.worker.ExecutorRunner" class="extype">ExecutorRunner</span>], <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/worker/html/index$.html b/site/docs/0.7.0/api/core/spark/deploy/worker/html/index$.html new file mode 100644 index 000000000..6bef55263 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/worker/html/index$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.worker.html.index</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.worker" class="extype" href="../package.html">worker</a>.<a name="spark.deploy.worker.html" class="extype" href="package.html">html</a></p> + <h1>index</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">index</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.WorkerState" class="extype">WorkerState</span>, <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.WorkerState" class="extype">WorkerState</span>, <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.deploy.worker.html.index" class="in"><span>index</span></li><li name="twirl.api.Template1" class="in"><span>Template1</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.worker.html.index#apply" data-isabs="false"> + <a id="apply(WorkerState):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="worker">worker: <span name="spark.deploy.WorkerState" class="extype">WorkerState</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.deploy.worker.html.index#f" data-isabs="false"> + <a id="f:(WorkerState) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (<span name="spark.deploy.WorkerState" class="extype">WorkerState</span>) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.deploy.worker.html.index#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.deploy.worker.html.index#ref" data-isabs="false"> + <a id="ref:spark.deploy.worker.html.index.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.deploy.worker.html.index.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy.worker.html.index#render" data-isabs="false"> + <a id="render(WorkerState):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="worker">worker: <span name="spark.deploy.WorkerState" class="extype">WorkerState</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.deploy.worker.html.index" class="extype" href="">index</a> → Template1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template1" class="parent"> + <h3>Inherited from <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="spark.deploy.WorkerState" class="extype">WorkerState</span>, <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/worker/html/package.html b/site/docs/0.7.0/api/core/spark/deploy/worker/html/package.html new file mode 100644 index 000000000..892c94556 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/worker/html/package.html @@ -0,0 +1,109 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.worker.html</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../../lib/template.css" /> + <script type="text/javascript" src="../../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../../lib/template.js"></script> + <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../../package.html">deploy</a>.<a name="spark.deploy.worker" class="extype" href="../package.html">worker</a></p> + <h1>html</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">html</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.deploy.worker.html.executor_row" data-isabs="false"> + <a id="executor_row:executor_row"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="executor_row$.html"><span class="name">executor_row</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template1[ExecutorRunner, Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li><li visbl="pub" name="spark.deploy.worker.html.executors_table" data-isabs="false"> + <a id="executors_table:executors_table"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="executors_table$.html"><span class="name">executors_table</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template1[List[ExecutorRunner], Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li><li visbl="pub" name="spark.deploy.worker.html.index" data-isabs="false"> + <a id="index:index"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="index$.html"><span class="name">index</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template1[WorkerState, Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/deploy/worker/package.html b/site/docs/0.7.0/api/core/spark/deploy/worker/package.html new file mode 100644 index 000000000..91b2edc7f --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/deploy/worker/package.html @@ -0,0 +1,85 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.deploy.worker</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.deploy" class="extype" href="../package.html">deploy</a></p> + <h1>worker</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">worker</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.deploy.worker.html" data-isabs="false"> + <a id="html:html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="html/package.html"><span class="name">html</span></a> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/package.html b/site/docs/0.7.0/api/core/spark/package.html new file mode 100644 index 000000000..0aa89655c --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/package.html @@ -0,0 +1,596 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../lib/template.css" /> + <script type="text/javascript" src="../lib/jquery.js"></script> + <script type="text/javascript" src="../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../lib/template.js"></script> + <script type="text/javascript" src="../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../lib/package_big.png" /> + + <h1>spark</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">spark</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Core Spark functionality. <a name="spark.SparkContext" class="extype" href="SparkContext.html">SparkContext</a> serves as the main entry point to Spark, while +<a name="spark.RDD" class="extype" href="RDD.html">RDD</a> is the data type representing a distributed collection, and provides most +parallel operations.</p><p>In addition, <a name="spark.PairRDDFunctions" class="extype" href="PairRDDFunctions.html">PairRDDFunctions</a> contains operations available only on RDDs of key-value +pairs, such as <code>groupByKey</code> and <code>join</code>; <a name="spark.DoubleRDDFunctions" class="extype" href="DoubleRDDFunctions.html">DoubleRDDFunctions</a> contains operations +available only on RDDs of Doubles; and <a name="spark.SequenceFileRDDFunctions" class="extype" href="SequenceFileRDDFunctions.html">SequenceFileRDDFunctions</a> contains operations +available on RDDs that can be saved as SequenceFiles. These operations are automatically +available on any RDD of the right type (e.g. RDD[(Int, Int)] through implicit conversions when +you <code>import spark.SparkContext._</code>. +</p></div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + <div class="types members" id="types"> + <h3>Type Members</h3> + <ol><li visbl="pub" name="spark.Accumulable" data-isabs="false"> + <a id="Accumulable:Accumulable[R, T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="Accumulable.html"><span class="name">Accumulable</span></a><span class="tparams">[<span name="R">R</span>, <span name="T">T</span>]</span><span class="result"> extends Serializable</span> + </span> + </h4> + <p class="comment cmt">A datatype that can be accumulated, i.</p> + </li><li visbl="pub" name="spark.AccumulableParam" data-isabs="true"> + <a id="AccumulableParam:AccumulableParam[R, T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <a href="AccumulableParam.html"><span class="name">AccumulableParam</span></a><span class="tparams">[<span name="R">R</span>, <span name="T">T</span>]</span><span class="result"> extends Serializable</span> + </span> + </h4> + <p class="comment cmt">Helper object defining how to accumulate values of a particular type.</p> + </li><li visbl="pub" name="spark.Accumulator" data-isabs="false"> + <a id="Accumulator:Accumulator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="Accumulator.html"><span class="name">Accumulator</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends Accumulable[T, T]</span> + </span> + </h4> + <p class="comment cmt">A simpler value of <a name="spark.Accumulable" class="extype" href="Accumulable.html">Accumulable</a> where the result type being accumulated is the same +as the types of elements being merged.</p> + </li><li visbl="pub" name="spark.AccumulatorParam" data-isabs="true"> + <a id="AccumulatorParam:AccumulatorParam[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <a href="AccumulatorParam.html"><span class="name">AccumulatorParam</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends AccumulableParam[T, T]</span> + </span> + </h4> + <p class="comment cmt">A simpler version of <a name="spark.AccumulableParam" class="extype" href="AccumulableParam.html">AccumulableParam</a> where the only datatype you can add in is the same type +as the accumulated value.</p> + </li><li visbl="pub" name="spark.Aggregator" data-isabs="false"> + <a id="Aggregator:Aggregator[K, V, C]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">case class</span> + </span> + <span class="symbol"> + <a href="Aggregator.html"><span class="name">Aggregator</span></a><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>, <span name="C">C</span>]</span><span class="params">(<span name="createCombiner">createCombiner: (V) ⇒ C</span>, <span name="mergeValue">mergeValue: (C, V) ⇒ C</span>, <span name="mergeCombiners">mergeCombiners: (C, C) ⇒ C</span>)</span><span class="result"> extends Product with Serializable</span> + </span> + </h4> + <p class="comment cmt">A set of functions used to aggregate data.</p> + </li><li visbl="pub" name="spark.Dependency" data-isabs="true"> + <a id="Dependency:Dependency[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="Dependency.html"><span class="name">Dependency</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends Serializable</span> + </span> + </h4> + <p class="comment cmt">Base class for dependencies.</p> + </li><li visbl="pub" name="spark.DoubleRDDFunctions" data-isabs="false"> + <a id="DoubleRDDFunctions:DoubleRDDFunctions"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="DoubleRDDFunctions.html"><span class="name">DoubleRDDFunctions</span></a><span class="result"> extends Logging with Serializable</span> + </span> + </h4> + <p class="comment cmt">Extra functions available on RDDs of Doubles through an implicit conversion.</p> + </li><li visbl="pub" name="spark.HashPartitioner" data-isabs="false"> + <a id="HashPartitioner:HashPartitioner"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="HashPartitioner.html"><span class="name">HashPartitioner</span></a><span class="result"> extends Partitioner</span> + </span> + </h4> + <p class="comment cmt">A <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a> that implements hash-based partitioning using Java's <code>Object.hashCode</code>.</p> + </li><li visbl="pub" name="spark.JavaSerializer" data-isabs="false"> + <a id="JavaSerializer:JavaSerializer"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="JavaSerializer.html"><span class="name">JavaSerializer</span></a><span class="result"> extends Serializer</span> + </span> + </h4> + <p class="comment cmt">A Spark serializer that uses Java's built-in serialization.</p> + </li><li visbl="pub" name="spark.KryoRegistrator" data-isabs="true"> + <a id="KryoRegistrator:KryoRegistrator"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <a href="KryoRegistrator.html"><span class="name">KryoRegistrator</span></a><span class="result"> extends AnyRef</span> + </span> + </h4> + <p class="comment cmt">Interface implemented by clients to register their classes with Kryo when using Kryo +serialization.</p> + </li><li visbl="pub" name="spark.KryoSerializer" data-isabs="false"> + <a id="KryoSerializer:KryoSerializer"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="KryoSerializer.html"><span class="name">KryoSerializer</span></a><span class="result"> extends Serializer with Logging</span> + </span> + </h4> + <p class="comment cmt">A Spark serializer that uses the <a href="http://code.google.com/p/kryo/wiki/V1Documentation">Kryo 1.x library</a>.</p> + </li><li visbl="pub" name="spark.Logging" data-isabs="true"> + <a id="Logging:Logging"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <a href="Logging.html"><span class="name">Logging</span></a><span class="result"> extends AnyRef</span> + </span> + </h4> + <p class="comment cmt">Utility trait for classes that want to log data.</p> + </li><li visbl="pub" name="spark.NarrowDependency" data-isabs="true"> + <a id="NarrowDependency:NarrowDependency[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="NarrowDependency.html"><span class="name">NarrowDependency</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends Dependency[T]</span> + </span> + </h4> + <p class="comment cmt">Base class for dependencies where each partition of the parent RDD is used by at most one +partition of the child RDD.</p> + </li><li visbl="pub" name="spark.OneToOneDependency" data-isabs="false"> + <a id="OneToOneDependency:OneToOneDependency[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="OneToOneDependency.html"><span class="name">OneToOneDependency</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends NarrowDependency[T]</span> + </span> + </h4> + <p class="comment cmt">Represents a one-to-one dependency between partitions of the parent and child RDDs.</p> + </li><li visbl="pub" name="spark.OrderedRDDFunctions" data-isabs="false"> + <a id="OrderedRDDFunctions:OrderedRDDFunctions[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="OrderedRDDFunctions.html"><span class="name">OrderedRDDFunctions</span></a><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends Logging with Serializable</span> + </span> + </h4> + <p class="comment cmt">Extra functions available on RDDs of (key, value) pairs where the key is sortable through +an implicit conversion.</p> + </li><li visbl="pub" name="spark.PairRDDFunctions" data-isabs="false"> + <a id="PairRDDFunctions:PairRDDFunctions[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="PairRDDFunctions.html"><span class="name">PairRDDFunctions</span></a><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends Logging with HadoopMapReduceUtil with Serializable</span> + </span> + </h4> + <p class="comment cmt">Extra functions available on RDDs of (key, value) pairs through an implicit conversion.</p> + </li><li visbl="pub" name="spark.Partition" data-isabs="true"> + <a id="Partition:Partition"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <a href="Partition.html"><span class="name">Partition</span></a><span class="result"> extends Serializable</span> + </span> + </h4> + <p class="comment cmt">A partition of an RDD.</p> + </li><li visbl="pub" name="spark.Partitioner" data-isabs="true"> + <a id="Partitioner:Partitioner"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="Partitioner.html"><span class="name">Partitioner</span></a><span class="result"> extends Serializable</span> + </span> + </h4> + <p class="comment cmt">An object that defines how the elements in a key-value pair RDD are partitioned by key.</p> + </li><li visbl="pub" name="spark.RDD" data-isabs="true"> + <a id="RDD:RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="RDD.html"><span class="name">RDD</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends Serializable with Logging</span> + </span> + </h4> + <p class="comment cmt">A Resilient Distributed Dataset (RDD), the basic abstraction in Spark.</p> + </li><li visbl="pub" name="spark.RangeDependency" data-isabs="false"> + <a id="RangeDependency:RangeDependency[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="RangeDependency.html"><span class="name">RangeDependency</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends NarrowDependency[T]</span> + </span> + </h4> + <p class="comment cmt">Represents a one-to-one dependency between ranges of partitions in the parent and child RDDs.</p> + </li><li visbl="pub" name="spark.RangePartitioner" data-isabs="false"> + <a id="RangePartitioner:RangePartitioner[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="RangePartitioner.html"><span class="name">RangePartitioner</span></a><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends Partitioner</span> + </span> + </h4> + <p class="comment cmt">A <a name="spark.Partitioner" class="extype" href="Partitioner.html">Partitioner</a> that partitions sortable records by range into roughly equal ranges.</p> + </li><li visbl="pub" name="spark.SequenceFileRDDFunctions" data-isabs="false"> + <a id="SequenceFileRDDFunctions:SequenceFileRDDFunctions[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="SequenceFileRDDFunctions.html"><span class="name">SequenceFileRDDFunctions</span></a><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends Logging with Serializable</span> + </span> + </h4> + <p class="comment cmt">Extra functions available on RDDs of (key, value) pairs to create a Hadoop SequenceFile, +through an implicit conversion.</p> + </li><li visbl="pub" name="spark.SerializableWritable" data-isabs="false"> + <a id="SerializableWritable:SerializableWritable[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="SerializableWritable.html"><span class="name">SerializableWritable</span></a><span class="tparams">[<span name="T">T <: Writable</span>]</span><span class="result"> extends Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.ShuffleDependency" data-isabs="false"> + <a id="ShuffleDependency:ShuffleDependency[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="ShuffleDependency.html"><span class="name">ShuffleDependency</span></a><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends Dependency[(K, V)]</span> + </span> + </h4> + <p class="comment cmt">Represents a dependency on the output of a shuffle stage.</p> + </li><li visbl="pub" name="spark.SparkContext" data-isabs="false"> + <a id="SparkContext:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="SparkContext.html"><span class="name">SparkContext</span></a><span class="result"> extends Logging</span> + </span> + </h4> + <p class="comment cmt">Main entry point for Spark functionality.</p> + </li><li visbl="pub" name="spark.SparkEnv" data-isabs="false"> + <a id="SparkEnv:SparkEnv"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="SparkEnv.html"><span class="name">SparkEnv</span></a><span class="result"> extends AnyRef</span> + </span> + </h4> + <p class="comment cmt">Holds all the runtime environment objects for a running Spark instance (either master or worker), +including the serializer, Akka actor system, block manager, map output tracker, etc.</p> + </li><li visbl="pub" name="spark.SparkException" data-isabs="false"> + <a id="SparkException:SparkException"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="SparkException.html"><span class="name">SparkException</span></a><span class="result"> extends Exception</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkFiles" data-isabs="false"> + <a id="SparkFiles:SparkFiles"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="SparkFiles.html"><span class="name">SparkFiles</span></a><span class="result"> extends AnyRef</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.TaskContext" data-isabs="false"> + <a id="TaskContext:TaskContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="TaskContext.html"><span class="name">TaskContext</span></a><span class="result"> extends Serializable</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.Partitioner" data-isabs="false"> + <a id="Partitioner:Partitioner"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="Partitioner$.html"><span class="name">Partitioner</span></a><span class="result"> extends Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkContext" data-isabs="false"> + <a id="SparkContext:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="SparkContext$.html"><span class="name">SparkContext</span></a><span class="result"> extends AnyRef</span> + </span> + </h4> + <p class="comment cmt">The SparkContext object contains a number of implicit conversions and parameters for use with +various Spark features.</p> + </li><li visbl="pub" name="spark.SparkEnv" data-isabs="false"> + <a id="SparkEnv:SparkEnv"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="SparkEnv$.html"><span class="name">SparkEnv</span></a><span class="result"> extends Logging</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.SparkFiles" data-isabs="false"> + <a id="SparkFiles:SparkFiles"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="SparkFiles$.html"><span class="name">SparkFiles</span></a><span class="result"> extends </span> + </span> + </h4> + + </li><li visbl="pub" name="spark.api" data-isabs="false"> + <a id="api:api"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="api/package.html"><span class="name">api</span></a> + </span> + </h4> + + </li><li visbl="pub" name="spark.broadcast" data-isabs="false"> + <a id="broadcast:broadcast"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="broadcast/package.html"><span class="name">broadcast</span></a> + </span> + </h4> + + </li><li visbl="pub" name="spark.common" data-isabs="false"> + <a id="common:common"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="common/package.html"><span class="name">common</span></a> + </span> + </h4> + + </li><li visbl="pub" name="spark.deploy" data-isabs="false"> + <a id="deploy:deploy"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="deploy/package.html"><span class="name">deploy</span></a> + </span> + </h4> + + </li><li visbl="pub" name="spark.partial" data-isabs="false"> + <a id="partial:partial"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="partial/package.html"><span class="name">partial</span></a> + </span> + </h4> + + </li><li visbl="pub" name="spark.rdd" data-isabs="false"> + <a id="rdd:rdd"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="rdd/package.html"><span class="name">rdd</span></a> + </span> + </h4> + + </li><li visbl="pub" name="spark.serializer" data-isabs="false"> + <a id="serializer:serializer"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="serializer/package.html"><span class="name">serializer</span></a> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage" data-isabs="false"> + <a id="storage:storage"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="storage/package.html"><span class="name">storage</span></a> + </span> + </h4> + + </li><li visbl="pub" name="spark.util" data-isabs="false"> + <a id="util:util"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="util/package.html"><span class="name">util</span></a> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/partial/BoundedDouble.html b/site/docs/0.7.0/api/core/spark/partial/BoundedDouble.html new file mode 100644 index 000000000..b3de41986 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/partial/BoundedDouble.html @@ -0,0 +1,419 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.partial.BoundedDouble</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.partial" class="extype" href="package.html">partial</a></p> + <h1>BoundedDouble</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">BoundedDouble</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A Double with error bars on it. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent">AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.partial.BoundedDouble" class="in"><span>BoundedDouble</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.partial.BoundedDouble#this" data-isabs="false"> + <a id="this:BoundedDouble"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">BoundedDouble</span><span class="params">(<span name="mean">mean: <span name="scala.Double" class="extype">Double</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span></span>, <span name="low">low: <span name="scala.Double" class="extype">Double</span></span>, <span name="high">high: <span name="scala.Double" class="extype">Double</span></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.partial.BoundedDouble#confidence" data-isabs="false"> + <a id="confidence:Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">confidence</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.partial.BoundedDouble#high" data-isabs="false"> + <a id="high:Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">high</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.partial.BoundedDouble#low" data-isabs="false"> + <a id="low:Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">low</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.partial.BoundedDouble#mean" data-isabs="false"> + <a id="mean:Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">mean</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.partial.BoundedDouble#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.partial.BoundedDouble" class="extype" href="">BoundedDouble</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/partial/PartialResult.html b/site/docs/0.7.0/api/core/spark/partial/PartialResult.html new file mode 100644 index 000000000..a5966468a --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/partial/PartialResult.html @@ -0,0 +1,446 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.partial.PartialResult</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.partial" class="extype" href="package.html">partial</a></p> + <h1>PartialResult</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">PartialResult</span><span class="tparams">[<span name="R">R</span>]</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent">AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.partial.PartialResult" class="in"><span>PartialResult</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.partial.PartialResult#this" data-isabs="false"> + <a id="this:PartialResult[R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">PartialResult</span><span class="params">(<span name="initialVal">initialVal: R</span>, <span name="isFinal">isFinal: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.partial.PartialResult#getFinalValue" data-isabs="false"> + <a id="getFinalValue():R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getFinalValue</span><span class="params">()</span><span class="result">: R</span> + </span> + </h4> + <p class="shortcomment cmt">Blocking method to wait for and return the final value.</p> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.partial.PartialResult#initialValue" data-isabs="false"> + <a id="initialValue:R"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initialValue</span><span class="result">: R</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.partial.PartialResult#isInitialValueFinal" data-isabs="false"> + <a id="isInitialValueFinal:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInitialValueFinal</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.partial.PartialResult#map" data-isabs="false"> + <a id="map[T]((R) ⇒ T):PartialResult[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="f">f: (R) ⇒ T</span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="">PartialResult</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Transform this PartialResult into a PartialResult of type T.</p> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.partial.PartialResult#onComplete" data-isabs="false"> + <a id="onComplete((R) ⇒ Unit):PartialResult[R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">onComplete</span><span class="params">(<span name="handler">handler: (R) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="">PartialResult</a>[R]</span> + </span> + </h4> + <p class="shortcomment cmt">Set a handler to be called when this PartialResult completes.</p><div class="fullcomment"><div class="comment cmt"><p>Set a handler to be called when this PartialResult completes. Only one completion handler +is supported per PartialResult. +</p></div></div> + </li><li visbl="pub" name="spark.partial.PartialResult#onFail" data-isabs="false"> + <a id="onFail((Exception) ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">onFail</span><span class="params">(<span name="handler">handler: (Exception) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Set a handler to be called if this PartialResult's job fails.</p><div class="fullcomment"><div class="comment cmt"><p>Set a handler to be called if this PartialResult's job fails. Only one failure handler +is supported per PartialResult. +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.partial.PartialResult#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.partial.PartialResult" class="extype" href="">PartialResult</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/partial/package.html b/site/docs/0.7.0/api/core/spark/partial/package.html new file mode 100644 index 000000000..12490d4d4 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/partial/package.html @@ -0,0 +1,97 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.partial</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a></p> + <h1>partial</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">partial</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + <div class="types members" id="types"> + <h3>Type Members</h3> + <ol><li visbl="pub" name="spark.partial.BoundedDouble" data-isabs="false"> + <a id="BoundedDouble:BoundedDouble"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="BoundedDouble.html"><span class="name">BoundedDouble</span></a><span class="result"> extends AnyRef</span> + </span> + </h4> + <p class="comment cmt">A Double with error bars on it.</p> + </li><li visbl="pub" name="spark.partial.PartialResult" data-isabs="false"> + <a id="PartialResult:PartialResult[R]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="PartialResult.html"><span class="name">PartialResult</span></a><span class="tparams">[<span name="R">R</span>]</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/CoGroupedRDD.html b/site/docs/0.7.0/api/core/spark/rdd/CoGroupedRDD.html new file mode 100644 index 000000000..8e8d330b3 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/CoGroupedRDD.html @@ -0,0 +1,1410 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.CoGroupedRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1>CoGroupedRDD</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">CoGroupedRDD</span><span class="tparams">[<span name="K">K</span>]</span><span class="result"> extends <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])], <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a>, <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.CoGroupedRDD" class="in"><span>CoGroupedRDD</span></li><li name="spark.RDD" class="in"><span>RDD</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.rdd.CoGroupedRDD#this" data-isabs="false"> + <a id="this:CoGroupedRDD[K]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">CoGroupedRDD</span><span class="params">(<span name="rdds">rdds: Seq[<a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[Tuple2[K, _]]]</span>, <span name="part">part: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#++" data-isabs="false"> + <a id="++(RDD[(K, Seq[Seq[_]])]):RDD[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#aggregate" data-isabs="false"> + <a id="aggregate[U](U)((U, (K, Seq[Seq[_]])) ⇒ U,(U, U) ⇒ U)(ClassManifest[U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: (U, (K, Seq[Seq[_]])) ⇒ U</span>, <span name="combOp">combOp: (U, U) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cache" data-isabs="false"> + <a id="cache():RDD[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cartesian" data-isabs="false"> + <a id="cartesian[U](RDD[U])(ClassManifest[U]):RDD[((K, Seq[Seq[_]]), U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[((K, Seq[Seq[_]]), U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#checkpoint" data-isabs="false"> + <a id="checkpoint():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpoint</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Mark this RDD for checkpointing.</p><div class="fullcomment"><div class="comment cmt"><p>Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint +directory set with SparkContext.setCheckpointDir() and all references to its parent +RDDs will be removed. This function must be called before any job has been +executed on this RDD. It is strongly recommended that this RDD is persisted in +memory, otherwise saving it on a file will require recomputation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.CoGroupedRDD#clearDependencies" data-isabs="false"> + <a id="clearDependencies():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearDependencies</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Clears the dependencies of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Clears the dependencies of this RDD. This method must ensure that all references +to the original parent RDDs is removed to enable the parent RDDs to be garbage +collected. Subclasses of RDD may override this method for implementing their own cleaning +logic. See <a name="spark.rdd.UnionRDD" class="extype" href="UnionRDD.html">UnionRDD</a> for an example. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.CoGroupedRDD" class="extype" href="">CoGroupedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#coalesce" data-isabs="false"> + <a id="coalesce(Int):RDD[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">coalesce</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD that is reduced into <code>numPartitions</code> partitions.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD that is reduced into <code>numPartitions</code> partitions. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect[U](PartialFunction[(K, Seq[Seq[_]]), U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[(K, Seq[Seq[_]]), U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD that contains all matching values by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD that contains all matching values by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect():Array[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.CoGroupedRDD#compute" data-isabs="false"> + <a id="compute(Partition,TaskContext):Iterator[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compute</span><span class="params">(<span name="s">s: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to compute a given partition.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to compute a given partition.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.CoGroupedRDD" class="extype" href="">CoGroupedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValue" data-isabs="false"> + <a id="countByValue():Map[(K, Seq[Seq[_]]), Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[(K, Seq[Seq[_]]), <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[(K, Seq[Seq[_]]), BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<span name="scala.collection.Map" class="extype">Map</span>[(K, Seq[Seq[_]]), <a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#dependencies" data-isabs="false"> + <a id="dependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct():RDD[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct(Int):RDD[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing the distinct elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#filter" data-isabs="false"> + <a id="filter(((K, Seq[Seq[_]])) ⇒ Boolean):RDD[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: ((K, Seq[Seq[_]])) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing only the elements that satisfy a predicate. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#first" data-isabs="false"> + <a id="first():(K, Seq[Seq[_]])"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: (K, Seq[Seq[_]])</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#firstParent" data-isabs="false"> + <a id="firstParent[U](ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">firstParent</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Returns the first parent RDD</p><div class="fullcomment"><div class="comment cmt"><p>Returns the first parent RDD</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="spark" class="extype" href="../package.html">spark</a>] </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#flatMap" data-isabs="false"> + <a id="flatMap[U](((K, Seq[Seq[_]])) ⇒ TraversableOnce[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((K, Seq[Seq[_]])) ⇒ TraversableOnce[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#fold" data-isabs="false"> + <a id="fold((K, Seq[Seq[_]]))(((K, Seq[Seq[_]]), (K, Seq[Seq[_]])) ⇒ (K, Seq[Seq[_]])):(K, Seq[Seq[_]])"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: (K, Seq[Seq[_]])</span>)</span><span class="params">(<span name="op">op: ((K, Seq[Seq[_]]), (K, Seq[Seq[_]])) ⇒ (K, Seq[Seq[_]])</span>)</span><span class="result">: (K, Seq[Seq[_]])</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#foreach" data-isabs="false"> + <a id="foreach(((K, Seq[Seq[_]])) ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: ((K, Seq[Seq[_]])) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getCheckpointFile" data-isabs="false"> + <a id="getCheckpointFile:Option[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCheckpointFile</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Gets the name of the file to which this RDD was checkpointed +</p><div class="fullcomment"><div class="comment cmt"><p>Gets the name of the file to which this RDD was checkpointed +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.rdd.CoGroupedRDD#getDependencies" data-isabs="false"> + <a id="getDependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getDependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return how this RDD depends on parent RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return how this RDD depends on parent RDDs. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.CoGroupedRDD" class="extype" href="">CoGroupedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.CoGroupedRDD#getPartitions" data-isabs="false"> + <a id="getPartitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPartitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return the set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return the set of partitions in this RDD. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.CoGroupedRDD" class="extype" href="">CoGroupedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#getPreferredLocations" data-isabs="false"> + <a id="getPreferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPreferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify placement preferences.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify placement preferences.</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#glom" data-isabs="false"> + <a id="glom():RDD[Array[(K, Seq[Seq[_]])]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[<span name="scala.Array" class="extype">Array</span>[(K, Seq[Seq[_]])]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, Seq[Seq[_]])) ⇒ K,Partitioner)(ClassManifest[K]):RDD[(K, Seq[(K, Seq[Seq[_]])])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, Seq[Seq[_]])) ⇒ K</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, Seq[Seq[_]])])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, Seq[Seq[_]])) ⇒ K,Int)(ClassManifest[K]):RDD[(K, Seq[(K, Seq[Seq[_]])])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, Seq[Seq[_]])) ⇒ K</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, Seq[Seq[_]])])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, Seq[Seq[_]])) ⇒ K)(ClassManifest[K]):RDD[(K, Seq[(K, Seq[Seq[_]])])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, Seq[Seq[_]])) ⇒ K</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, Seq[Seq[_]])])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#isCheckpointed" data-isabs="false"> + <a id="isCheckpointed:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isCheckpointed</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return whether this RDD has been checkpointed or not +</p><div class="fullcomment"><div class="comment cmt"><p>Return whether this RDD has been checkpointed or not +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#iterator" data-isabs="false"> + <a id="iterator(Partition,TaskContext):Iterator[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#keyBy" data-isabs="false"> + <a id="keyBy[K](((K, Seq[Seq[_]])) ⇒ K):RDD[(K, (K, Seq[Seq[_]]))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, Seq[Seq[_]])) ⇒ K</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, (K, Seq[Seq[_]]))]</span> + </span> + </h4> + <p class="shortcomment cmt">Creates tuples of the elements in this RDD by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Creates tuples of the elements in this RDD by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#map" data-isabs="false"> + <a id="map[U](((K, Seq[Seq[_]])) ⇒ U)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((K, Seq[Seq[_]])) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U]((Iterator[(K, Seq[Seq[_]])]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (Iterator[(K, Seq[Seq[_]])]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitionsWithIndex" data-isabs="false"> + <a id="mapPartitionsWithIndex[U]((Int, Iterator[(K, Seq[Seq[_]])]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitionsWithIndex</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[(K, Seq[Seq[_]])]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#name" data-isabs="false"> + <a id="name:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">name</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A friendly name for this RDD</p><div class="fullcomment"><div class="comment cmt"><p>A friendly name for this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.rdd.CoGroupedRDD#partitioner" data-isabs="false"> + <a id="partitioner:Some[Partitioner]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitioner</span><span class="result">: <span name="scala.Some" class="extype">Some</span>[<a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify how they are partitioned.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify how they are partitioned.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.CoGroupedRDD" class="extype" href="">CoGroupedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitions" data-isabs="false"> + <a id="partitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">partitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist():RDD[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):RDD[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String],Map[String, String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>, <span name="env">env: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(String):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#preferredLocations" data-isabs="false"> + <a id="preferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.CoGroupedRDD#rdds" data-isabs="false"> + <a id="rdds:Seq[RDD[Tuple2[K, _]]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">rdds</span><span class="result">: Seq[<a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[Tuple2[K, _]]]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.RDD#reduce" data-isabs="false"> + <a id="reduce(((K, Seq[Seq[_]]), (K, Seq[Seq[_]])) ⇒ (K, Seq[Seq[_]])):(K, Seq[Seq[_]])"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: ((K, Seq[Seq[_]]), (K, Seq[Seq[_]])) ⇒ (K, Seq[Seq[_]])</span>)</span><span class="result">: (K, Seq[Seq[_]])</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified commutative and associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified commutative and associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):RDD[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a sampled subset of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#setName" data-isabs="false"> + <a id="setName(String):RDD[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setName</span><span class="params">(<span name="_name">_name: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Assign a name to this RDD</p><div class="fullcomment"><div class="comment cmt"><p>Assign a name to this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[(K, Seq[Seq[_]])],Partitioner):RDD[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[(K, Seq[Seq[_]])],Int):RDD[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[(K, Seq[Seq[_]])]):RDD[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><p>Uses <code>this</code> partitioner/partition size, because even if <code>other</code> is huge, the resulting +RDD will be <= us. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#take" data-isabs="false"> + <a id="take(Int):Array[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):Array[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toArray" data-isabs="false"> + <a id="toArray():Array[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toDebugString" data-isabs="false"> + <a id="toDebugString:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toDebugString</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A description of this RDD and its recursive dependencies for debugging.</p><div class="fullcomment"><div class="comment cmt"><p>A description of this RDD and its recursive dependencies for debugging.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#union" data-isabs="false"> + <a id="union(RDD[(K, Seq[Seq[_]])]):RDD[(K, Seq[Seq[_]])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#zip" data-isabs="false"> + <a id="zip[U](RDD[U])(ClassManifest[U]):RDD[((K, Seq[Seq[_]]), U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[((K, Seq[Seq[_]]), U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc.</p><div class="fullcomment"><div class="comment cmt"><p>Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc. Assumes that the two RDDs have the *same number of +partitions* and the *same number of elements in each partition* (e.g. one was made through +a map on the other). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="spark.RDD#mapPartitionsWithSplit" data-isabs="false"> + <a id="mapPartitionsWithSplit[U]((Int, Iterator[(K, Seq[Seq[_]])]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version scala.this.deprecated.init$default$2) use mapPartitionsWithIndex">mapPartitionsWithSplit</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[(K, Seq[Seq[_]])]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version scala.this.deprecated.init$default$2)</i> use mapPartitionsWithIndex</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="spark.RDD" class="parent"> + <h3>Inherited from <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[Seq[_]])]</h3> + </div><div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/CoalescedRDD.html b/site/docs/0.7.0/api/core/spark/rdd/CoalescedRDD.html new file mode 100644 index 000000000..c047db9d4 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/CoalescedRDD.html @@ -0,0 +1,1414 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.CoalescedRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1>CoalescedRDD</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">CoalescedRDD</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Coalesce the partitions of a parent RDD (<code>prev</code>) into fewer partitions, so that each partition of +this RDD computes one or more of the parent ones. Will produce exactly <code>maxPartitions</code> if the +parent had more than this many partitions, or fewer if the parent had fewer.</p><p>This transformation is useful when an RDD with many partitions gets filtered into a smaller one, +or to avoid having a large number of small tasks when processing a directory with many files. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T], <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a>, <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.CoalescedRDD" class="in"><span>CoalescedRDD</span></li><li name="spark.RDD" class="in"><span>RDD</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.rdd.CoalescedRDD#this" data-isabs="false"> + <a id="this:CoalescedRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">CoalescedRDD</span><span class="params">(<span name="prev">prev: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="maxPartitions">maxPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#++" data-isabs="false"> + <a id="++(RDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#aggregate" data-isabs="false"> + <a id="aggregate[U](U)((U, T) ⇒ U,(U, U) ⇒ U)(ClassManifest[U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: (U, T) ⇒ U</span>, <span name="combOp">combOp: (U, U) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cache" data-isabs="false"> + <a id="cache():RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cartesian" data-isabs="false"> + <a id="cartesian[U](RDD[U])(ClassManifest[U]):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#checkpoint" data-isabs="false"> + <a id="checkpoint():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpoint</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Mark this RDD for checkpointing.</p><div class="fullcomment"><div class="comment cmt"><p>Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint +directory set with SparkContext.setCheckpointDir() and all references to its parent +RDDs will be removed. This function must be called before any job has been +executed on this RDD. It is strongly recommended that this RDD is persisted in +memory, otherwise saving it on a file will require recomputation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.CoalescedRDD#clearDependencies" data-isabs="false"> + <a id="clearDependencies():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearDependencies</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Clears the dependencies of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Clears the dependencies of this RDD. This method must ensure that all references +to the original parent RDDs is removed to enable the parent RDDs to be garbage +collected. Subclasses of RDD may override this method for implementing their own cleaning +logic. See <a name="spark.rdd.UnionRDD" class="extype" href="UnionRDD.html">UnionRDD</a> for an example. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.CoalescedRDD" class="extype" href="">CoalescedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#coalesce" data-isabs="false"> + <a id="coalesce(Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">coalesce</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD that is reduced into <code>numPartitions</code> partitions.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD that is reduced into <code>numPartitions</code> partitions. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect[U](PartialFunction[T, U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[T, U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD that contains all matching values by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD that contains all matching values by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect():Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.CoalescedRDD#compute" data-isabs="false"> + <a id="compute(Partition,TaskContext):Iterator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compute</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to compute a given partition.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to compute a given partition.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.CoalescedRDD" class="extype" href="">CoalescedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValue" data-isabs="false"> + <a id="countByValue():Map[T, Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[T, <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[T, BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<span name="scala.collection.Map" class="extype">Map</span>[T, <a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#dependencies" data-isabs="false"> + <a id="dependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct():RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct(Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing the distinct elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#filter" data-isabs="false"> + <a id="filter((T) ⇒ Boolean):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: (T) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing only the elements that satisfy a predicate. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#first" data-isabs="false"> + <a id="first():T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#firstParent" data-isabs="false"> + <a id="firstParent[U](ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">firstParent</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Returns the first parent RDD</p><div class="fullcomment"><div class="comment cmt"><p>Returns the first parent RDD</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="spark" class="extype" href="../package.html">spark</a>] </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#flatMap" data-isabs="false"> + <a id="flatMap[U]((T) ⇒ TraversableOnce[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (T) ⇒ TraversableOnce[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#fold" data-isabs="false"> + <a id="fold(T)((T, T) ⇒ T):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: T</span>)</span><span class="params">(<span name="op">op: (T, T) ⇒ T</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#foreach" data-isabs="false"> + <a id="foreach((T) ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: (T) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getCheckpointFile" data-isabs="false"> + <a id="getCheckpointFile:Option[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCheckpointFile</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Gets the name of the file to which this RDD was checkpointed +</p><div class="fullcomment"><div class="comment cmt"><p>Gets the name of the file to which this RDD was checkpointed +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.rdd.CoalescedRDD#getDependencies" data-isabs="false"> + <a id="getDependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getDependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return how this RDD depends on parent RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return how this RDD depends on parent RDDs. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.CoalescedRDD" class="extype" href="">CoalescedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.CoalescedRDD#getPartitions" data-isabs="false"> + <a id="getPartitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPartitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return the set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return the set of partitions in this RDD. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.CoalescedRDD" class="extype" href="">CoalescedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#getPreferredLocations" data-isabs="false"> + <a id="getPreferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPreferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify placement preferences.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify placement preferences.</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#glom" data-isabs="false"> + <a id="glom():RDD[Array[T]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[<span name="scala.Array" class="extype">Array</span>[T]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((T) ⇒ K,Partitioner)(ClassManifest[K]):RDD[(K, Seq[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[T])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((T) ⇒ K,Int)(ClassManifest[K]):RDD[(K, Seq[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[T])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((T) ⇒ K)(ClassManifest[K]):RDD[(K, Seq[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[T])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#isCheckpointed" data-isabs="false"> + <a id="isCheckpointed:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isCheckpointed</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return whether this RDD has been checkpointed or not +</p><div class="fullcomment"><div class="comment cmt"><p>Return whether this RDD has been checkpointed or not +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#iterator" data-isabs="false"> + <a id="iterator(Partition,TaskContext):Iterator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#keyBy" data-isabs="false"> + <a id="keyBy[K]((T) ⇒ K):RDD[(K, T)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, T)]</span> + </span> + </h4> + <p class="shortcomment cmt">Creates tuples of the elements in this RDD by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Creates tuples of the elements in this RDD by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#map" data-isabs="false"> + <a id="map[U]((T) ⇒ U)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (T) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U]((Iterator[T]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (Iterator[T]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitionsWithIndex" data-isabs="false"> + <a id="mapPartitionsWithIndex[U]((Int, Iterator[T]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitionsWithIndex</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[T]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#name" data-isabs="false"> + <a id="name:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">name</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A friendly name for this RDD</p><div class="fullcomment"><div class="comment cmt"><p>A friendly name for this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitioner" data-isabs="false"> + <a id="partitioner:Option[Partitioner]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitioner</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[<a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify how they are partitioned.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify how they are partitioned.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitions" data-isabs="false"> + <a id="partitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">partitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist():RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String],Map[String, String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>, <span name="env">env: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(String):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#preferredLocations" data-isabs="false"> + <a id="preferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.CoalescedRDD#prev" data-isabs="false"> + <a id="prev:RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">prev</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.RDD#reduce" data-isabs="false"> + <a id="reduce((T, T) ⇒ T):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: (T, T) ⇒ T</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified commutative and associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified commutative and associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a sampled subset of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#setName" data-isabs="false"> + <a id="setName(String):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setName</span><span class="params">(<span name="_name">_name: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Assign a name to this RDD</p><div class="fullcomment"><div class="comment cmt"><p>Assign a name to this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[T],Partitioner):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[T],Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><p>Uses <code>this</code> partitioner/partition size, because even if <code>other</code> is huge, the resulting +RDD will be <= us. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#take" data-isabs="false"> + <a id="take(Int):Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toArray" data-isabs="false"> + <a id="toArray():Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toDebugString" data-isabs="false"> + <a id="toDebugString:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toDebugString</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A description of this RDD and its recursive dependencies for debugging.</p><div class="fullcomment"><div class="comment cmt"><p>A description of this RDD and its recursive dependencies for debugging.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#union" data-isabs="false"> + <a id="union(RDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#zip" data-isabs="false"> + <a id="zip[U](RDD[U])(ClassManifest[U]):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc.</p><div class="fullcomment"><div class="comment cmt"><p>Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc. Assumes that the two RDDs have the *same number of +partitions* and the *same number of elements in each partition* (e.g. one was made through +a map on the other). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="spark.RDD#mapPartitionsWithSplit" data-isabs="false"> + <a id="mapPartitionsWithSplit[U]((Int, Iterator[T]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version scala.this.deprecated.init$default$2) use mapPartitionsWithIndex">mapPartitionsWithSplit</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[T]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version scala.this.deprecated.init$default$2)</i> use mapPartitionsWithIndex</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="spark.RDD" class="parent"> + <h3>Inherited from <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</h3> + </div><div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/HadoopRDD.html b/site/docs/0.7.0/api/core/spark/rdd/HadoopRDD.html new file mode 100644 index 000000000..844a75ad1 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/HadoopRDD.html @@ -0,0 +1,1412 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.HadoopRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1>HadoopRDD</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">HadoopRDD</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)] with <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>An RDD that reads a Hadoop dataset as specified by a JobConf (e.g. files in HDFS, the local file +system, or S3, tables in HBase, etc). +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)], <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a>, <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.HadoopRDD" class="in"><span>HadoopRDD</span></li><li name="spark.RDD" class="in"><span>RDD</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.rdd.HadoopRDD#this" data-isabs="false"> + <a id="this:HadoopRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">HadoopRDD</span><span class="params">(<span name="sc">sc: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span>, <span name="conf">conf: <span name="org.apache.hadoop.mapred.JobConf" class="extype">JobConf</span></span>, <span name="inputFormatClass">inputFormatClass: Class[_ <: org.apache.hadoop.mapred.InputFormat[K,V]]</span>, <span name="keyClass">keyClass: Class[K]</span>, <span name="valueClass">valueClass: Class[V]</span>, <span name="minSplits">minSplits: <span name="scala.Int" class="extype">Int</span></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#++" data-isabs="false"> + <a id="++(RDD[(K, V)]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#aggregate" data-isabs="false"> + <a id="aggregate[U](U)((U, (K, V)) ⇒ U,(U, U) ⇒ U)(ClassManifest[U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: (U, (K, V)) ⇒ U</span>, <span name="combOp">combOp: (U, U) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cache" data-isabs="false"> + <a id="cache():RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cartesian" data-isabs="false"> + <a id="cartesian[U](RDD[U])(ClassManifest[U]):RDD[((K, V), U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[((K, V), U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.HadoopRDD#checkpoint" data-isabs="false"> + <a id="checkpoint():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpoint</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Mark this RDD for checkpointing.</p><div class="fullcomment"><div class="comment cmt"><p>Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint +directory set with SparkContext.setCheckpointDir() and all references to its parent +RDDs will be removed. This function must be called before any job has been +executed on this RDD. It is strongly recommended that this RDD is persisted in +memory, otherwise saving it on a file will require recomputation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.HadoopRDD" class="extype" href="">HadoopRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#clearDependencies" data-isabs="false"> + <a id="clearDependencies():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearDependencies</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Clears the dependencies of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Clears the dependencies of this RDD. This method must ensure that all references +to the original parent RDDs is removed to enable the parent RDDs to be garbage +collected. Subclasses of RDD may override this method for implementing their own cleaning +logic. See <a name="spark.rdd.UnionRDD" class="extype" href="UnionRDD.html">UnionRDD</a> for an example. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#coalesce" data-isabs="false"> + <a id="coalesce(Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">coalesce</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD that is reduced into <code>numPartitions</code> partitions.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD that is reduced into <code>numPartitions</code> partitions. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect[U](PartialFunction[(K, V), U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[(K, V), U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD that contains all matching values by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD that contains all matching values by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect():Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.HadoopRDD#compute" data-isabs="false"> + <a id="compute(Partition,TaskContext):Iterator[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compute</span><span class="params">(<span name="theSplit">theSplit: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to compute a given partition.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to compute a given partition.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.HadoopRDD" class="extype" href="">HadoopRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValue" data-isabs="false"> + <a id="countByValue():Map[(K, V), Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[(K, V), <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[(K, V), BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<span name="scala.collection.Map" class="extype">Map</span>[(K, V), <a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.HadoopRDD#createInputFormat" data-isabs="false"> + <a id="createInputFormat(JobConf):InputFormat[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">createInputFormat</span><span class="params">(<span name="conf">conf: <span name="org.apache.hadoop.mapred.JobConf" class="extype">JobConf</span></span>)</span><span class="result">: <span name="org.apache.hadoop.mapred.InputFormat" class="extype">InputFormat</span>[K, V]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.RDD#dependencies" data-isabs="false"> + <a id="dependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct():RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct(Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing the distinct elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#filter" data-isabs="false"> + <a id="filter(((K, V)) ⇒ Boolean):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: ((K, V)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing only the elements that satisfy a predicate. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#first" data-isabs="false"> + <a id="first():(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#firstParent" data-isabs="false"> + <a id="firstParent[U](ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">firstParent</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Returns the first parent RDD</p><div class="fullcomment"><div class="comment cmt"><p>Returns the first parent RDD</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="spark" class="extype" href="../package.html">spark</a>] </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#flatMap" data-isabs="false"> + <a id="flatMap[U](((K, V)) ⇒ TraversableOnce[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ TraversableOnce[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#fold" data-isabs="false"> + <a id="fold((K, V))(((K, V), (K, V)) ⇒ (K, V)):(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: (K, V)</span>)</span><span class="params">(<span name="op">op: ((K, V), (K, V)) ⇒ (K, V)</span>)</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#foreach" data-isabs="false"> + <a id="foreach(((K, V)) ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: ((K, V)) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getCheckpointFile" data-isabs="false"> + <a id="getCheckpointFile:Option[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCheckpointFile</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Gets the name of the file to which this RDD was checkpointed +</p><div class="fullcomment"><div class="comment cmt"><p>Gets the name of the file to which this RDD was checkpointed +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.RDD#getDependencies" data-isabs="false"> + <a id="getDependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getDependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return how this RDD depends on parent RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return how this RDD depends on parent RDDs. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.HadoopRDD#getPartitions" data-isabs="false"> + <a id="getPartitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPartitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return the set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return the set of partitions in this RDD. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.HadoopRDD" class="extype" href="">HadoopRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.HadoopRDD#getPreferredLocations" data-isabs="false"> + <a id="getPreferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPreferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify placement preferences.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify placement preferences.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.HadoopRDD" class="extype" href="">HadoopRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#glom" data-isabs="false"> + <a id="glom():RDD[Array[(K, V)]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[<span name="scala.Array" class="extype">Array</span>[(K, V)]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, V)) ⇒ K,Partitioner)(ClassManifest[K]):RDD[(K, Seq[(K, V)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, V)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, V)) ⇒ K,Int)(ClassManifest[K]):RDD[(K, Seq[(K, V)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, V)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, V)) ⇒ K)(ClassManifest[K]):RDD[(K, Seq[(K, V)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, V)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#isCheckpointed" data-isabs="false"> + <a id="isCheckpointed:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isCheckpointed</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return whether this RDD has been checkpointed or not +</p><div class="fullcomment"><div class="comment cmt"><p>Return whether this RDD has been checkpointed or not +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#iterator" data-isabs="false"> + <a id="iterator(Partition,TaskContext):Iterator[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#keyBy" data-isabs="false"> + <a id="keyBy[K](((K, V)) ⇒ K):RDD[(K, (K, V))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, (K, V))]</span> + </span> + </h4> + <p class="shortcomment cmt">Creates tuples of the elements in this RDD by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Creates tuples of the elements in this RDD by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#map" data-isabs="false"> + <a id="map[U](((K, V)) ⇒ U)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U]((Iterator[(K, V)]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (Iterator[(K, V)]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitionsWithIndex" data-isabs="false"> + <a id="mapPartitionsWithIndex[U]((Int, Iterator[(K, V)]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitionsWithIndex</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[(K, V)]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#name" data-isabs="false"> + <a id="name:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">name</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A friendly name for this RDD</p><div class="fullcomment"><div class="comment cmt"><p>A friendly name for this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitioner" data-isabs="false"> + <a id="partitioner:Option[Partitioner]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitioner</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[<a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify how they are partitioned.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify how they are partitioned.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitions" data-isabs="false"> + <a id="partitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">partitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist():RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String],Map[String, String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>, <span name="env">env: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(String):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#preferredLocations" data-isabs="false"> + <a id="preferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#reduce" data-isabs="false"> + <a id="reduce(((K, V), (K, V)) ⇒ (K, V)):(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: ((K, V), (K, V)) ⇒ (K, V)</span>)</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified commutative and associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified commutative and associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a sampled subset of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#setName" data-isabs="false"> + <a id="setName(String):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setName</span><span class="params">(<span name="_name">_name: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Assign a name to this RDD</p><div class="fullcomment"><div class="comment cmt"><p>Assign a name to this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[(K, V)],Partitioner):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[(K, V)],Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[(K, V)]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><p>Uses <code>this</code> partitioner/partition size, because even if <code>other</code> is huge, the resulting +RDD will be <= us. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#take" data-isabs="false"> + <a id="take(Int):Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toArray" data-isabs="false"> + <a id="toArray():Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toDebugString" data-isabs="false"> + <a id="toDebugString:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toDebugString</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A description of this RDD and its recursive dependencies for debugging.</p><div class="fullcomment"><div class="comment cmt"><p>A description of this RDD and its recursive dependencies for debugging.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#union" data-isabs="false"> + <a id="union(RDD[(K, V)]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#zip" data-isabs="false"> + <a id="zip[U](RDD[U])(ClassManifest[U]):RDD[((K, V), U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[((K, V), U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc.</p><div class="fullcomment"><div class="comment cmt"><p>Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc. Assumes that the two RDDs have the *same number of +partitions* and the *same number of elements in each partition* (e.g. one was made through +a map on the other). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="spark.RDD#mapPartitionsWithSplit" data-isabs="false"> + <a id="mapPartitionsWithSplit[U]((Int, Iterator[(K, V)]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version scala.this.deprecated.init$default$2) use mapPartitionsWithIndex">mapPartitionsWithSplit</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[(K, V)]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version scala.this.deprecated.init$default$2)</i> use mapPartitionsWithIndex</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="spark.RDD" class="parent"> + <h3>Inherited from <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</h3> + </div><div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/NewHadoopRDD.html b/site/docs/0.7.0/api/core/spark/rdd/NewHadoopRDD.html new file mode 100644 index 000000000..679ffa634 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/NewHadoopRDD.html @@ -0,0 +1,1424 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.NewHadoopRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1>NewHadoopRDD</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">NewHadoopRDD</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)] with <a name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil" class="extype" href="../../org/apache/hadoop/mapreduce/HadoopMapReduceUtil.html">HadoopMapReduceUtil</a> with <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil" class="extype" href="../../org/apache/hadoop/mapreduce/HadoopMapReduceUtil.html">HadoopMapReduceUtil</a>, <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)], <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a>, <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.NewHadoopRDD" class="in"><span>NewHadoopRDD</span></li><li name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil" class="in"><span>HadoopMapReduceUtil</span></li><li name="spark.RDD" class="in"><span>RDD</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.rdd.NewHadoopRDD#this" data-isabs="false"> + <a id="this:NewHadoopRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">NewHadoopRDD</span><span class="params">(<span name="sc">sc: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span>, <span name="inputFormatClass">inputFormatClass: Class[_ <: org.apache.hadoop.mapreduce.InputFormat[K,V]]</span>, <span name="keyClass">keyClass: Class[K]</span>, <span name="valueClass">valueClass: Class[V]</span>, <span name="conf">conf: <span name="org.apache.hadoop.conf.Configuration" class="extype">Configuration</span></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#++" data-isabs="false"> + <a id="++(RDD[(K, V)]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#aggregate" data-isabs="false"> + <a id="aggregate[U](U)((U, (K, V)) ⇒ U,(U, U) ⇒ U)(ClassManifest[U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: (U, (K, V)) ⇒ U</span>, <span name="combOp">combOp: (U, U) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cache" data-isabs="false"> + <a id="cache():RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cartesian" data-isabs="false"> + <a id="cartesian[U](RDD[U])(ClassManifest[U]):RDD[((K, V), U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[((K, V), U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#checkpoint" data-isabs="false"> + <a id="checkpoint():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpoint</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Mark this RDD for checkpointing.</p><div class="fullcomment"><div class="comment cmt"><p>Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint +directory set with SparkContext.setCheckpointDir() and all references to its parent +RDDs will be removed. This function must be called before any job has been +executed on this RDD. It is strongly recommended that this RDD is persisted in +memory, otherwise saving it on a file will require recomputation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#clearDependencies" data-isabs="false"> + <a id="clearDependencies():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearDependencies</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Clears the dependencies of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Clears the dependencies of this RDD. This method must ensure that all references +to the original parent RDDs is removed to enable the parent RDDs to be garbage +collected. Subclasses of RDD may override this method for implementing their own cleaning +logic. See <a name="spark.rdd.UnionRDD" class="extype" href="UnionRDD.html">UnionRDD</a> for an example. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#coalesce" data-isabs="false"> + <a id="coalesce(Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">coalesce</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD that is reduced into <code>numPartitions</code> partitions.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD that is reduced into <code>numPartitions</code> partitions. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect[U](PartialFunction[(K, V), U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[(K, V), U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD that contains all matching values by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD that contains all matching values by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect():Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.NewHadoopRDD#compute" data-isabs="false"> + <a id="compute(Partition,TaskContext):Iterator[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compute</span><span class="params">(<span name="theSplit">theSplit: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to compute a given partition.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to compute a given partition.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.NewHadoopRDD" class="extype" href="">NewHadoopRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValue" data-isabs="false"> + <a id="countByValue():Map[(K, V), Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[(K, V), <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[(K, V), BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<span name="scala.collection.Map" class="extype">Map</span>[(K, V), <a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#dependencies" data-isabs="false"> + <a id="dependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct():RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct(Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing the distinct elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#filter" data-isabs="false"> + <a id="filter(((K, V)) ⇒ Boolean):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: ((K, V)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing only the elements that satisfy a predicate. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#first" data-isabs="false"> + <a id="first():(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#firstParent" data-isabs="false"> + <a id="firstParent[U](ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">firstParent</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Returns the first parent RDD</p><div class="fullcomment"><div class="comment cmt"><p>Returns the first parent RDD</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="spark" class="extype" href="../package.html">spark</a>] </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#flatMap" data-isabs="false"> + <a id="flatMap[U](((K, V)) ⇒ TraversableOnce[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ TraversableOnce[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#fold" data-isabs="false"> + <a id="fold((K, V))(((K, V), (K, V)) ⇒ (K, V)):(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: (K, V)</span>)</span><span class="params">(<span name="op">op: ((K, V), (K, V)) ⇒ (K, V)</span>)</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#foreach" data-isabs="false"> + <a id="foreach(((K, V)) ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: ((K, V)) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getCheckpointFile" data-isabs="false"> + <a id="getCheckpointFile:Option[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCheckpointFile</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Gets the name of the file to which this RDD was checkpointed +</p><div class="fullcomment"><div class="comment cmt"><p>Gets the name of the file to which this RDD was checkpointed +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.RDD#getDependencies" data-isabs="false"> + <a id="getDependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getDependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return how this RDD depends on parent RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return how this RDD depends on parent RDDs. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.NewHadoopRDD#getPartitions" data-isabs="false"> + <a id="getPartitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPartitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return the set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return the set of partitions in this RDD. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.NewHadoopRDD" class="extype" href="">NewHadoopRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.NewHadoopRDD#getPreferredLocations" data-isabs="false"> + <a id="getPreferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPreferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify placement preferences.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify placement preferences.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.NewHadoopRDD" class="extype" href="">NewHadoopRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#glom" data-isabs="false"> + <a id="glom():RDD[Array[(K, V)]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[<span name="scala.Array" class="extype">Array</span>[(K, V)]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, V)) ⇒ K,Partitioner)(ClassManifest[K]):RDD[(K, Seq[(K, V)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, V)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, V)) ⇒ K,Int)(ClassManifest[K]):RDD[(K, Seq[(K, V)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, V)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, V)) ⇒ K)(ClassManifest[K]):RDD[(K, Seq[(K, V)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, V)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#isCheckpointed" data-isabs="false"> + <a id="isCheckpointed:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isCheckpointed</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return whether this RDD has been checkpointed or not +</p><div class="fullcomment"><div class="comment cmt"><p>Return whether this RDD has been checkpointed or not +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#iterator" data-isabs="false"> + <a id="iterator(Partition,TaskContext):Iterator[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#keyBy" data-isabs="false"> + <a id="keyBy[K](((K, V)) ⇒ K):RDD[(K, (K, V))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, (K, V))]</span> + </span> + </h4> + <p class="shortcomment cmt">Creates tuples of the elements in this RDD by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Creates tuples of the elements in this RDD by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#map" data-isabs="false"> + <a id="map[U](((K, V)) ⇒ U)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U]((Iterator[(K, V)]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (Iterator[(K, V)]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitionsWithIndex" data-isabs="false"> + <a id="mapPartitionsWithIndex[U]((Int, Iterator[(K, V)]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitionsWithIndex</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[(K, V)]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#name" data-isabs="false"> + <a id="name:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">name</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A friendly name for this RDD</p><div class="fullcomment"><div class="comment cmt"><p>A friendly name for this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil#newJobContext" data-isabs="false"> + <a id="newJobContext(Configuration,JobID):JobContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">newJobContext</span><span class="params">(<span name="conf">conf: <span name="org.apache.hadoop.conf.Configuration" class="extype">Configuration</span></span>, <span name="jobId">jobId: <span name="org.apache.hadoop.mapreduce.JobID" class="extype">JobID</span></span>)</span><span class="result">: <span name="org.apache.hadoop.mapreduce.JobContext" class="extype">JobContext</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil" class="extype" href="../../org/apache/hadoop/mapreduce/HadoopMapReduceUtil.html">HadoopMapReduceUtil</a></dd></dl></div> + </li><li visbl="pub" name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil#newTaskAttemptContext" data-isabs="false"> + <a id="newTaskAttemptContext(Configuration,TaskAttemptID):TaskAttemptContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">newTaskAttemptContext</span><span class="params">(<span name="conf">conf: <span name="org.apache.hadoop.conf.Configuration" class="extype">Configuration</span></span>, <span name="attemptId">attemptId: <span name="org.apache.hadoop.mapreduce.TaskAttemptID" class="extype">TaskAttemptID</span></span>)</span><span class="result">: <span name="org.apache.hadoop.mapreduce.TaskAttemptContext" class="extype">TaskAttemptContext</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil" class="extype" href="../../org/apache/hadoop/mapreduce/HadoopMapReduceUtil.html">HadoopMapReduceUtil</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitioner" data-isabs="false"> + <a id="partitioner:Option[Partitioner]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitioner</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[<a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify how they are partitioned.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify how they are partitioned.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitions" data-isabs="false"> + <a id="partitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">partitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist():RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String],Map[String, String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>, <span name="env">env: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(String):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#preferredLocations" data-isabs="false"> + <a id="preferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#reduce" data-isabs="false"> + <a id="reduce(((K, V), (K, V)) ⇒ (K, V)):(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: ((K, V), (K, V)) ⇒ (K, V)</span>)</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified commutative and associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified commutative and associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a sampled subset of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#setName" data-isabs="false"> + <a id="setName(String):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setName</span><span class="params">(<span name="_name">_name: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Assign a name to this RDD</p><div class="fullcomment"><div class="comment cmt"><p>Assign a name to this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[(K, V)],Partitioner):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[(K, V)],Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[(K, V)]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><p>Uses <code>this</code> partitioner/partition size, because even if <code>other</code> is huge, the resulting +RDD will be <= us. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#take" data-isabs="false"> + <a id="take(Int):Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toArray" data-isabs="false"> + <a id="toArray():Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toDebugString" data-isabs="false"> + <a id="toDebugString:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toDebugString</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A description of this RDD and its recursive dependencies for debugging.</p><div class="fullcomment"><div class="comment cmt"><p>A description of this RDD and its recursive dependencies for debugging.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#union" data-isabs="false"> + <a id="union(RDD[(K, V)]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#zip" data-isabs="false"> + <a id="zip[U](RDD[U])(ClassManifest[U]):RDD[((K, V), U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[((K, V), U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc.</p><div class="fullcomment"><div class="comment cmt"><p>Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc. Assumes that the two RDDs have the *same number of +partitions* and the *same number of elements in each partition* (e.g. one was made through +a map on the other). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="spark.RDD#mapPartitionsWithSplit" data-isabs="false"> + <a id="mapPartitionsWithSplit[U]((Int, Iterator[(K, V)]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version scala.this.deprecated.init$default$2) use mapPartitionsWithIndex">mapPartitionsWithSplit</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[(K, V)]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version scala.this.deprecated.init$default$2)</i> use mapPartitionsWithIndex</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil" class="parent"> + <h3>Inherited from <a name="org.apache.hadoop.mapreduce.HadoopMapReduceUtil" class="extype" href="../../org/apache/hadoop/mapreduce/HadoopMapReduceUtil.html">HadoopMapReduceUtil</a></h3> + </div><div name="spark.RDD" class="parent"> + <h3>Inherited from <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</h3> + </div><div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/PartitionPruningRDD$.html b/site/docs/0.7.0/api/core/spark/rdd/PartitionPruningRDD$.html new file mode 100644 index 000000000..b7cd0b346 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/PartitionPruningRDD$.html @@ -0,0 +1,385 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.PartitionPruningRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="PartitionPruningRDD.html"><img src="../../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1><a title="Go to companion" href="PartitionPruningRDD.html">PartitionPruningRDD</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">PartitionPruningRDD</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.PartitionPruningRDD" class="in"><span>PartitionPruningRDD</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.rdd.PartitionPruningRDD#create" data-isabs="false"> + <a id="create[T](RDD[T],(Int) ⇒ Boolean):PartitionPruningRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">create</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="partitionFilterFunc">partitionFilterFunc: (<span name="scala.Int" class="extype">Int</span>) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.rdd.PartitionPruningRDD" class="extype" href="PartitionPruningRDD.html">PartitionPruningRDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Create a PartitionPruningRDD.</p><div class="fullcomment"><div class="comment cmt"><p>Create a PartitionPruningRDD. This function can be used to create the PartitionPruningRDD +when its type T is not known at compile time. +</p></div></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="spark.rdd.PartitionPruningRDD#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/PartitionPruningRDD.html b/site/docs/0.7.0/api/core/spark/rdd/PartitionPruningRDD.html new file mode 100644 index 000000000..2a1de91a5 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/PartitionPruningRDD.html @@ -0,0 +1,1402 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.PartitionPruningRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="PartitionPruningRDD$.html"><img src="../../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1><a title="Go to companion" href="PartitionPruningRDD$.html">PartitionPruningRDD</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">PartitionPruningRDD</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A RDD used to prune RDD partitions/partitions so we can avoid launching tasks on +all partitions. An example use case: If we know the RDD is partitioned by range, +and the execution DAG has a filter on the key, we can avoid launching tasks +on partitions that don't have the range covering the key. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T], <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a>, <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.PartitionPruningRDD" class="in"><span>PartitionPruningRDD</span></li><li name="spark.RDD" class="in"><span>RDD</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.rdd.PartitionPruningRDD#this" data-isabs="false"> + <a id="this:PartitionPruningRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">PartitionPruningRDD</span><span class="params">(<span name="prev">prev: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="partitionFilterFunc">partitionFilterFunc: (<span name="scala.Int" class="extype">Int</span>) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#++" data-isabs="false"> + <a id="++(RDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#aggregate" data-isabs="false"> + <a id="aggregate[U](U)((U, T) ⇒ U,(U, U) ⇒ U)(ClassManifest[U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: (U, T) ⇒ U</span>, <span name="combOp">combOp: (U, U) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cache" data-isabs="false"> + <a id="cache():RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cartesian" data-isabs="false"> + <a id="cartesian[U](RDD[U])(ClassManifest[U]):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#checkpoint" data-isabs="false"> + <a id="checkpoint():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpoint</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Mark this RDD for checkpointing.</p><div class="fullcomment"><div class="comment cmt"><p>Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint +directory set with SparkContext.setCheckpointDir() and all references to its parent +RDDs will be removed. This function must be called before any job has been +executed on this RDD. It is strongly recommended that this RDD is persisted in +memory, otherwise saving it on a file will require recomputation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#clearDependencies" data-isabs="false"> + <a id="clearDependencies():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearDependencies</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Clears the dependencies of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Clears the dependencies of this RDD. This method must ensure that all references +to the original parent RDDs is removed to enable the parent RDDs to be garbage +collected. Subclasses of RDD may override this method for implementing their own cleaning +logic. See <a name="spark.rdd.UnionRDD" class="extype" href="UnionRDD.html">UnionRDD</a> for an example. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#coalesce" data-isabs="false"> + <a id="coalesce(Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">coalesce</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD that is reduced into <code>numPartitions</code> partitions.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD that is reduced into <code>numPartitions</code> partitions. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect[U](PartialFunction[T, U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[T, U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD that contains all matching values by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD that contains all matching values by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect():Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.PartitionPruningRDD#compute" data-isabs="false"> + <a id="compute(Partition,TaskContext):Iterator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compute</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to compute a given partition.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to compute a given partition.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.PartitionPruningRDD" class="extype" href="">PartitionPruningRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValue" data-isabs="false"> + <a id="countByValue():Map[T, Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[T, <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[T, BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<span name="scala.collection.Map" class="extype">Map</span>[T, <a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#dependencies" data-isabs="false"> + <a id="dependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct():RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct(Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing the distinct elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#filter" data-isabs="false"> + <a id="filter((T) ⇒ Boolean):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: (T) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing only the elements that satisfy a predicate. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#first" data-isabs="false"> + <a id="first():T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#firstParent" data-isabs="false"> + <a id="firstParent[U](ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">firstParent</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Returns the first parent RDD</p><div class="fullcomment"><div class="comment cmt"><p>Returns the first parent RDD</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="spark" class="extype" href="../package.html">spark</a>] </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#flatMap" data-isabs="false"> + <a id="flatMap[U]((T) ⇒ TraversableOnce[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (T) ⇒ TraversableOnce[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#fold" data-isabs="false"> + <a id="fold(T)((T, T) ⇒ T):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: T</span>)</span><span class="params">(<span name="op">op: (T, T) ⇒ T</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#foreach" data-isabs="false"> + <a id="foreach((T) ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: (T) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getCheckpointFile" data-isabs="false"> + <a id="getCheckpointFile:Option[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCheckpointFile</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Gets the name of the file to which this RDD was checkpointed +</p><div class="fullcomment"><div class="comment cmt"><p>Gets the name of the file to which this RDD was checkpointed +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.RDD#getDependencies" data-isabs="false"> + <a id="getDependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getDependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return how this RDD depends on parent RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return how this RDD depends on parent RDDs. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.rdd.PartitionPruningRDD#getPartitions" data-isabs="false"> + <a id="getPartitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPartitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return the set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return the set of partitions in this RDD. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.rdd.PartitionPruningRDD" class="extype" href="">PartitionPruningRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#getPreferredLocations" data-isabs="false"> + <a id="getPreferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPreferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify placement preferences.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify placement preferences.</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#glom" data-isabs="false"> + <a id="glom():RDD[Array[T]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[<span name="scala.Array" class="extype">Array</span>[T]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((T) ⇒ K,Partitioner)(ClassManifest[K]):RDD[(K, Seq[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[T])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((T) ⇒ K,Int)(ClassManifest[K]):RDD[(K, Seq[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[T])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((T) ⇒ K)(ClassManifest[K]):RDD[(K, Seq[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[T])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#isCheckpointed" data-isabs="false"> + <a id="isCheckpointed:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isCheckpointed</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return whether this RDD has been checkpointed or not +</p><div class="fullcomment"><div class="comment cmt"><p>Return whether this RDD has been checkpointed or not +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#iterator" data-isabs="false"> + <a id="iterator(Partition,TaskContext):Iterator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#keyBy" data-isabs="false"> + <a id="keyBy[K]((T) ⇒ K):RDD[(K, T)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, T)]</span> + </span> + </h4> + <p class="shortcomment cmt">Creates tuples of the elements in this RDD by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Creates tuples of the elements in this RDD by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#map" data-isabs="false"> + <a id="map[U]((T) ⇒ U)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (T) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U]((Iterator[T]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (Iterator[T]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitionsWithIndex" data-isabs="false"> + <a id="mapPartitionsWithIndex[U]((Int, Iterator[T]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitionsWithIndex</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[T]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#name" data-isabs="false"> + <a id="name:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">name</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A friendly name for this RDD</p><div class="fullcomment"><div class="comment cmt"><p>A friendly name for this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitioner" data-isabs="false"> + <a id="partitioner:Option[Partitioner]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitioner</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[<a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify how they are partitioned.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify how they are partitioned.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitions" data-isabs="false"> + <a id="partitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">partitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist():RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String],Map[String, String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>, <span name="env">env: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(String):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#preferredLocations" data-isabs="false"> + <a id="preferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#reduce" data-isabs="false"> + <a id="reduce((T, T) ⇒ T):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: (T, T) ⇒ T</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified commutative and associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified commutative and associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a sampled subset of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#setName" data-isabs="false"> + <a id="setName(String):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setName</span><span class="params">(<span name="_name">_name: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Assign a name to this RDD</p><div class="fullcomment"><div class="comment cmt"><p>Assign a name to this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[T],Partitioner):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[T],Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><p>Uses <code>this</code> partitioner/partition size, because even if <code>other</code> is huge, the resulting +RDD will be <= us. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#take" data-isabs="false"> + <a id="take(Int):Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toArray" data-isabs="false"> + <a id="toArray():Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toDebugString" data-isabs="false"> + <a id="toDebugString:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toDebugString</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A description of this RDD and its recursive dependencies for debugging.</p><div class="fullcomment"><div class="comment cmt"><p>A description of this RDD and its recursive dependencies for debugging.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#union" data-isabs="false"> + <a id="union(RDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#zip" data-isabs="false"> + <a id="zip[U](RDD[U])(ClassManifest[U]):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc.</p><div class="fullcomment"><div class="comment cmt"><p>Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc. Assumes that the two RDDs have the *same number of +partitions* and the *same number of elements in each partition* (e.g. one was made through +a map on the other). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="spark.RDD#mapPartitionsWithSplit" data-isabs="false"> + <a id="mapPartitionsWithSplit[U]((Int, Iterator[T]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version scala.this.deprecated.init$default$2) use mapPartitionsWithIndex">mapPartitionsWithSplit</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[T]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version scala.this.deprecated.init$default$2)</i> use mapPartitionsWithIndex</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="spark.RDD" class="parent"> + <h3>Inherited from <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</h3> + </div><div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/PartitionPruningRDDPartition.html b/site/docs/0.7.0/api/core/spark/rdd/PartitionPruningRDDPartition.html new file mode 100644 index 000000000..89710d4fe --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/PartitionPruningRDDPartition.html @@ -0,0 +1,402 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.PartitionPruningRDDPartition</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1>PartitionPruningRDDPartition</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">PartitionPruningRDDPartition</span><span class="result"> extends <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>, <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.PartitionPruningRDDPartition" class="in"><span>PartitionPruningRDDPartition</span></li><li name="spark.Partition" class="in"><span>Partition</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.rdd.PartitionPruningRDDPartition#this" data-isabs="false"> + <a id="this:PartitionPruningRDDPartition"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">PartitionPruningRDDPartition</span><span class="params">(<span name="idx">idx: <span name="scala.Int" class="extype">Int</span></span>, <span name="parentSplit">parentSplit: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.Partition#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.Partition" class="extype" href="../Partition.html">Partition</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.rdd.PartitionPruningRDDPartition#index" data-isabs="false"> + <a id="index:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">index</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">Get the split's index within its parent RDD +</p><div class="fullcomment"><div class="comment cmt"><p>Get the split's index within its parent RDD +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.PartitionPruningRDDPartition" class="extype" href="">PartitionPruningRDDPartition</a> → <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.rdd.PartitionPruningRDDPartition#parentSplit" data-isabs="false"> + <a id="parentSplit:Partition"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">parentSplit</span><span class="result">: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.Partition" class="parent"> + <h3>Inherited from <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/PipedRDD$.html b/site/docs/0.7.0/api/core/spark/rdd/PipedRDD$.html new file mode 100644 index 000000000..aa2b75da6 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/PipedRDD$.html @@ -0,0 +1,383 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.PipedRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="PipedRDD.html"><img src="../../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1><a title="Go to companion" href="PipedRDD.html">PipedRDD</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">PipedRDD</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.PipedRDD" class="in"><span>PipedRDD</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="spark.rdd.PipedRDD#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.rdd.PipedRDD#tokenize" data-isabs="false"> + <a id="tokenize(String):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">tokenize</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/PipedRDD.html b/site/docs/0.7.0/api/core/spark/rdd/PipedRDD.html new file mode 100644 index 000000000..474fba36e --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/PipedRDD.html @@ -0,0 +1,1424 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.PipedRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="PipedRDD$.html"><img src="../../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1><a title="Go to companion" href="PipedRDD$.html">PipedRDD</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">PipedRDD</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>An RDD that pipes the contents of each parent partition through an external command +(printing them one per line) and returns the output as a collection of strings. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String], <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a>, <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.PipedRDD" class="in"><span>PipedRDD</span></li><li name="spark.RDD" class="in"><span>RDD</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.rdd.PipedRDD#this" data-isabs="false"> + <a id="this:PipedRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">PipedRDD</span><span class="params">(<span name="prev">prev: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="command">command: String</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.rdd.PipedRDD#this" data-isabs="false"> + <a id="this:PipedRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">PipedRDD</span><span class="params">(<span name="prev">prev: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="command">command: Seq[String]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.rdd.PipedRDD#this" data-isabs="false"> + <a id="this:PipedRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">PipedRDD</span><span class="params">(<span name="prev">prev: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="command">command: Seq[String]</span>, <span name="envVars">envVars: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#++" data-isabs="false"> + <a id="++(RDD[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#aggregate" data-isabs="false"> + <a id="aggregate[U](U)((U, String) ⇒ U,(U, U) ⇒ U)(ClassManifest[U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: (U, String) ⇒ U</span>, <span name="combOp">combOp: (U, U) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cache" data-isabs="false"> + <a id="cache():RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cartesian" data-isabs="false"> + <a id="cartesian[U](RDD[U])(ClassManifest[U]):RDD[(String, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(String, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#checkpoint" data-isabs="false"> + <a id="checkpoint():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpoint</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Mark this RDD for checkpointing.</p><div class="fullcomment"><div class="comment cmt"><p>Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint +directory set with SparkContext.setCheckpointDir() and all references to its parent +RDDs will be removed. This function must be called before any job has been +executed on this RDD. It is strongly recommended that this RDD is persisted in +memory, otherwise saving it on a file will require recomputation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#clearDependencies" data-isabs="false"> + <a id="clearDependencies():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearDependencies</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Clears the dependencies of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Clears the dependencies of this RDD. This method must ensure that all references +to the original parent RDDs is removed to enable the parent RDDs to be garbage +collected. Subclasses of RDD may override this method for implementing their own cleaning +logic. See <a name="spark.rdd.UnionRDD" class="extype" href="UnionRDD.html">UnionRDD</a> for an example. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#coalesce" data-isabs="false"> + <a id="coalesce(Int):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">coalesce</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD that is reduced into <code>numPartitions</code> partitions.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD that is reduced into <code>numPartitions</code> partitions. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect[U](PartialFunction[String, U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[String, U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD that contains all matching values by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD that contains all matching values by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect():Array[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.PipedRDD#compute" data-isabs="false"> + <a id="compute(Partition,TaskContext):Iterator[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compute</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to compute a given partition.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to compute a given partition.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.PipedRDD" class="extype" href="">PipedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValue" data-isabs="false"> + <a id="countByValue():Map[String, Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[String, <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[String, BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<span name="scala.collection.Map" class="extype">Map</span>[String, <a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#dependencies" data-isabs="false"> + <a id="dependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct():RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct(Int):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing the distinct elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#filter" data-isabs="false"> + <a id="filter((String) ⇒ Boolean):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: (String) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing only the elements that satisfy a predicate. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#first" data-isabs="false"> + <a id="first():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#firstParent" data-isabs="false"> + <a id="firstParent[U](ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">firstParent</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Returns the first parent RDD</p><div class="fullcomment"><div class="comment cmt"><p>Returns the first parent RDD</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="spark" class="extype" href="../package.html">spark</a>] </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#flatMap" data-isabs="false"> + <a id="flatMap[U]((String) ⇒ TraversableOnce[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (String) ⇒ TraversableOnce[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#fold" data-isabs="false"> + <a id="fold(String)((String, String) ⇒ String):String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: String</span>)</span><span class="params">(<span name="op">op: (String, String) ⇒ String</span>)</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#foreach" data-isabs="false"> + <a id="foreach((String) ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: (String) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getCheckpointFile" data-isabs="false"> + <a id="getCheckpointFile:Option[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCheckpointFile</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Gets the name of the file to which this RDD was checkpointed +</p><div class="fullcomment"><div class="comment cmt"><p>Gets the name of the file to which this RDD was checkpointed +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.RDD#getDependencies" data-isabs="false"> + <a id="getDependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getDependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return how this RDD depends on parent RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return how this RDD depends on parent RDDs. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.PipedRDD#getPartitions" data-isabs="false"> + <a id="getPartitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPartitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return the set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return the set of partitions in this RDD. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.PipedRDD" class="extype" href="">PipedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#getPreferredLocations" data-isabs="false"> + <a id="getPreferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPreferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify placement preferences.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify placement preferences.</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#glom" data-isabs="false"> + <a id="glom():RDD[Array[String]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[<span name="scala.Array" class="extype">Array</span>[String]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((String) ⇒ K,Partitioner)(ClassManifest[K]):RDD[(K, Seq[String])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (String) ⇒ K</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[String])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((String) ⇒ K,Int)(ClassManifest[K]):RDD[(K, Seq[String])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (String) ⇒ K</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[String])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((String) ⇒ K)(ClassManifest[K]):RDD[(K, Seq[String])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (String) ⇒ K</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[String])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#isCheckpointed" data-isabs="false"> + <a id="isCheckpointed:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isCheckpointed</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return whether this RDD has been checkpointed or not +</p><div class="fullcomment"><div class="comment cmt"><p>Return whether this RDD has been checkpointed or not +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#iterator" data-isabs="false"> + <a id="iterator(Partition,TaskContext):Iterator[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#keyBy" data-isabs="false"> + <a id="keyBy[K]((String) ⇒ K):RDD[(K, String)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (String) ⇒ K</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, String)]</span> + </span> + </h4> + <p class="shortcomment cmt">Creates tuples of the elements in this RDD by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Creates tuples of the elements in this RDD by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#map" data-isabs="false"> + <a id="map[U]((String) ⇒ U)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (String) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U]((Iterator[String]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (Iterator[String]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitionsWithIndex" data-isabs="false"> + <a id="mapPartitionsWithIndex[U]((Int, Iterator[String]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitionsWithIndex</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[String]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#name" data-isabs="false"> + <a id="name:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">name</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A friendly name for this RDD</p><div class="fullcomment"><div class="comment cmt"><p>A friendly name for this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitioner" data-isabs="false"> + <a id="partitioner:Option[Partitioner]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitioner</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[<a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify how they are partitioned.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify how they are partitioned.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitions" data-isabs="false"> + <a id="partitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">partitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist():RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String],Map[String, String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>, <span name="env">env: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(String):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#preferredLocations" data-isabs="false"> + <a id="preferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#reduce" data-isabs="false"> + <a id="reduce((String, String) ⇒ String):String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: (String, String) ⇒ String</span>)</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified commutative and associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified commutative and associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a sampled subset of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#setName" data-isabs="false"> + <a id="setName(String):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setName</span><span class="params">(<span name="_name">_name: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Assign a name to this RDD</p><div class="fullcomment"><div class="comment cmt"><p>Assign a name to this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[String],Partitioner):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[String],Int):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><p>Uses <code>this</code> partitioner/partition size, because even if <code>other</code> is huge, the resulting +RDD will be <= us. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#take" data-isabs="false"> + <a id="take(Int):Array[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):Array[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[String]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toArray" data-isabs="false"> + <a id="toArray():Array[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toDebugString" data-isabs="false"> + <a id="toDebugString:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toDebugString</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A description of this RDD and its recursive dependencies for debugging.</p><div class="fullcomment"><div class="comment cmt"><p>A description of this RDD and its recursive dependencies for debugging.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#union" data-isabs="false"> + <a id="union(RDD[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#zip" data-isabs="false"> + <a id="zip[U](RDD[U])(ClassManifest[U]):RDD[(String, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(String, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc.</p><div class="fullcomment"><div class="comment cmt"><p>Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc. Assumes that the two RDDs have the *same number of +partitions* and the *same number of elements in each partition* (e.g. one was made through +a map on the other). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="spark.RDD#mapPartitionsWithSplit" data-isabs="false"> + <a id="mapPartitionsWithSplit[U]((Int, Iterator[String]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version scala.this.deprecated.init$default$2) use mapPartitionsWithIndex">mapPartitionsWithSplit</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[String]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version scala.this.deprecated.init$default$2)</i> use mapPartitionsWithIndex</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="spark.RDD" class="parent"> + <h3>Inherited from <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</h3> + </div><div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/PruneDependency.html b/site/docs/0.7.0/api/core/spark/rdd/PruneDependency.html new file mode 100644 index 000000000..09c7ee646 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/PruneDependency.html @@ -0,0 +1,405 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.PruneDependency</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1>PruneDependency</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">PruneDependency</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <a name="spark.NarrowDependency" class="extype" href="../NarrowDependency.html">NarrowDependency</a>[T]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Represents a dependency between the PartitionPruningRDD and its parent. In this +case, the child RDD contains a subset of partitions of the parents'. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.NarrowDependency" class="extype" href="../NarrowDependency.html">NarrowDependency</a>[T], <a name="spark.Dependency" class="extype" href="../Dependency.html">Dependency</a>[T], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.PruneDependency" class="in"><span>PruneDependency</span></li><li name="spark.NarrowDependency" class="in"><span>NarrowDependency</span></li><li name="spark.Dependency" class="in"><span>Dependency</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.rdd.PruneDependency#this" data-isabs="false"> + <a id="this:PruneDependency[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">PruneDependency</span><span class="params">(<span name="rdd">rdd: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="partitionFilterFunc">partitionFilterFunc: (<span name="scala.Int" class="extype">Int</span>) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.rdd.PruneDependency#getParents" data-isabs="false"> + <a id="getParents(Int):List[Int]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getParents</span><span class="params">(<span name="partitionId">partitionId: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.immutable.List" class="extype">List</span>[<span name="scala.Int" class="extype">Int</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the parent partitions for a child partition.</p><div class="fullcomment"><div class="comment cmt"><p>Get the parent partitions for a child partition.</p></div><dl class="paramcmts block"><dt class="param">partitionId</dt><dd class="cmt"><p>a partition of the child RDD</p></dd><dt>returns</dt><dd class="cmt"><p>the partitions of the parent RDD that the child partition depends upon +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.PruneDependency" class="extype" href="">PruneDependency</a> → <a name="spark.NarrowDependency" class="extype" href="../NarrowDependency.html">NarrowDependency</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.rdd.PruneDependency#partitions" data-isabs="false"> + <a id="partitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.NarrowDependency" class="parent"> + <h3>Inherited from <a name="spark.NarrowDependency" class="extype" href="../NarrowDependency.html">NarrowDependency</a>[T]</h3> + </div><div name="spark.Dependency" class="parent"> + <h3>Inherited from <a name="spark.Dependency" class="extype" href="../Dependency.html">Dependency</a>[T]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/RepartitionShuffledRDD.html b/site/docs/0.7.0/api/core/spark/rdd/RepartitionShuffledRDD.html new file mode 100644 index 000000000..c3c70b6ec --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/RepartitionShuffledRDD.html @@ -0,0 +1,982 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.RepartitionShuffledRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1>RepartitionShuffledRDD</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">RepartitionShuffledRDD</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends <a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a>[K, V, V]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Repartition a key-value pair RDD. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a>[K, V, V], <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div><div class="toggleContainer block"> + <span class="toggle">Known Subclasses</span> + <div class="subClasses hiddenContent"><a name="spark.rdd.ShuffledSortedRDD" class="extype" href="ShuffledSortedRDD.html">ShuffledSortedRDD</a></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.RepartitionShuffledRDD" class="in"><span>RepartitionShuffledRDD</span></li><li name="spark.rdd.ShuffledRDD" class="in"><span>ShuffledRDD</span></li><li name="spark.RDD" class="in"><span>RDD</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.rdd.RepartitionShuffledRDD#this" data-isabs="false"> + <a id="this:RepartitionShuffledRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">RepartitionShuffledRDD</span><span class="params">(<span name="parent">parent: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>, <span name="part">part: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#++" data-isabs="false"> + <a id="++(RDD[(K, V)]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#aggregate" data-isabs="false"> + <a id="aggregate[U](U)((U, (K, V)) ⇒ U,(U, U) ⇒ U)(ClassManifest[U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: (U, (K, V)) ⇒ U</span>, <span name="combOp">combOp: (U, U) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cache" data-isabs="false"> + <a id="cache():RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cartesian" data-isabs="false"> + <a id="cartesian[U](RDD[U])(ClassManifest[U]):RDD[((K, V), U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[((K, V), U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect():Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.RepartitionShuffledRDD#compute" data-isabs="false"> + <a id="compute(Split):Iterator[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compute</span><span class="params">(<span name="split">split: <a name="spark.Split" class="extype" href="../Split.html">Split</a></span>)</span><span class="result">: Iterator[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Function for computing a given partition.</p><div class="fullcomment"><div class="comment cmt"><p>Function for computing a given partition.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.RepartitionShuffledRDD" class="extype" href="">RepartitionShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValue" data-isabs="false"> + <a id="countByValue():Map[(K, V), Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[(K, V), <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[(K, V), BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<span name="scala.collection.Map" class="extype">Map</span>[(K, V), <a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#dep" data-isabs="false"> + <a id="dep:ShuffleDependency[K, V, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">dep</span><span class="result">: <a name="spark.ShuffleDependency" class="extype" href="../ShuffleDependency.html">ShuffleDependency</a>[K, V, V]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#dependencies" data-isabs="false"> + <a id="dependencies:List[ShuffleDependency[K, V, V]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">dependencies</span><span class="result">: <span name="scala.collection.immutable.List" class="extype">List</span>[<a name="spark.ShuffleDependency" class="extype" href="../ShuffleDependency.html">ShuffleDependency</a>[K, V, V]]</span> + </span> + </h4> + <p class="shortcomment cmt">How this RDD depends on any parent RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>How this RDD depends on any parent RDDs.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct(Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numSplits">numSplits: <span name="scala.Int" class="extype">Int</span> = <span class="symbol"><span class="name"><a href="../RDD.html#splits:Array[Split]">splits.size</a></span></span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing the distinct elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#filter" data-isabs="false"> + <a id="filter(((K, V)) ⇒ Boolean):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: ((K, V)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing only the elements that satisfy a predicate. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#first" data-isabs="false"> + <a id="first():(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#flatMap" data-isabs="false"> + <a id="flatMap[U](((K, V)) ⇒ TraversableOnce[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ TraversableOnce[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#fold" data-isabs="false"> + <a id="fold((K, V))(((K, V), (K, V)) ⇒ (K, V)):(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: (K, V)</span>)</span><span class="params">(<span name="op">op: ((K, V), (K, V)) ⇒ (K, V)</span>)</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#foreach" data-isabs="false"> + <a id="foreach(((K, V)) ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: ((K, V)) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#glom" data-isabs="false"> + <a id="glom():RDD[Array[(K, V)]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[<span name="scala.Array" class="extype">Array</span>[(K, V)]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, V)) ⇒ K)(ClassManifest[K]):RDD[(K, Seq[(K, V)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, V)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, V)) ⇒ K,Int)(ClassManifest[K]):RDD[(K, Seq[(K, V)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>, <span name="numSplits">numSplits: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, V)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#iterator" data-isabs="false"> + <a id="iterator(Split):Iterator[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Split" class="extype" href="../Split.html">Split</a></span>)</span><span class="result">: Iterator[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#map" data-isabs="false"> + <a id="map[U](((K, V)) ⇒ U)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U]((Iterator[(K, V)]) ⇒ Iterator[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (Iterator[(K, V)]) ⇒ Iterator[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitionsWithSplit" data-isabs="false"> + <a id="mapPartitionsWithSplit[U]((Int, Iterator[(K, V)]) ⇒ Iterator[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitionsWithSplit</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[(K, V)]) ⇒ Iterator[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#partitioner" data-isabs="false"> + <a id="partitioner:Some[Partitioner]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitioner</span><span class="result">: <span name="scala.Some" class="extype">Some</span>[<a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify how they are partitioned.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify how they are partitioned.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist():RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String],Map[String, String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>, <span name="env">env: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(String):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#preferredLocations" data-isabs="false"> + <a id="preferredLocations(Split):scala.collection.immutable.Nil.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Split" class="extype" href="../Split.html">Split</a></span>)</span><span class="result">: scala.collection.immutable.Nil.type</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify placement preferences.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify placement preferences.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#reduce" data-isabs="false"> + <a id="reduce(((K, V), (K, V)) ⇒ (K, V)):(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: ((K, V), (K, V)) ⇒ (K, V)</span>)</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a sampled subset of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#splits" data-isabs="false"> + <a id="splits:Array[Split]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">splits</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Split" class="extype" href="../Split.html">Split</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Set of partitions in this RDD.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#splits_" data-isabs="false"> + <a id="splits_:Array[Split]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">splits_</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Split" class="extype" href="../Split.html">Split</a>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#take" data-isabs="false"> + <a id="take(Int):Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toArray" data-isabs="false"> + <a id="toArray():Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#union" data-isabs="false"> + <a id="union(RDD[(K, V)]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.rdd.ShuffledRDD" class="parent"> + <h3>Inherited from <a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a>[K, V, V]</h3> + </div><div name="spark.RDD" class="parent"> + <h3>Inherited from <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/SampledRDD.html b/site/docs/0.7.0/api/core/spark/rdd/SampledRDD.html new file mode 100644 index 000000000..c5ef87495 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/SampledRDD.html @@ -0,0 +1,1398 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.SampledRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1>SampledRDD</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">SampledRDD</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T], <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a>, <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.SampledRDD" class="in"><span>SampledRDD</span></li><li name="spark.RDD" class="in"><span>RDD</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.rdd.SampledRDD#this" data-isabs="false"> + <a id="this:SampledRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">SampledRDD</span><span class="params">(<span name="prev">prev: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="frac">frac: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#++" data-isabs="false"> + <a id="++(RDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#aggregate" data-isabs="false"> + <a id="aggregate[U](U)((U, T) ⇒ U,(U, U) ⇒ U)(ClassManifest[U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: (U, T) ⇒ U</span>, <span name="combOp">combOp: (U, U) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cache" data-isabs="false"> + <a id="cache():RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cartesian" data-isabs="false"> + <a id="cartesian[U](RDD[U])(ClassManifest[U]):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#checkpoint" data-isabs="false"> + <a id="checkpoint():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpoint</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Mark this RDD for checkpointing.</p><div class="fullcomment"><div class="comment cmt"><p>Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint +directory set with SparkContext.setCheckpointDir() and all references to its parent +RDDs will be removed. This function must be called before any job has been +executed on this RDD. It is strongly recommended that this RDD is persisted in +memory, otherwise saving it on a file will require recomputation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#clearDependencies" data-isabs="false"> + <a id="clearDependencies():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearDependencies</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Clears the dependencies of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Clears the dependencies of this RDD. This method must ensure that all references +to the original parent RDDs is removed to enable the parent RDDs to be garbage +collected. Subclasses of RDD may override this method for implementing their own cleaning +logic. See <a name="spark.rdd.UnionRDD" class="extype" href="UnionRDD.html">UnionRDD</a> for an example. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#coalesce" data-isabs="false"> + <a id="coalesce(Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">coalesce</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD that is reduced into <code>numPartitions</code> partitions.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD that is reduced into <code>numPartitions</code> partitions. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect[U](PartialFunction[T, U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[T, U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD that contains all matching values by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD that contains all matching values by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect():Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.SampledRDD#compute" data-isabs="false"> + <a id="compute(Partition,TaskContext):Iterator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compute</span><span class="params">(<span name="splitIn">splitIn: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to compute a given partition.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to compute a given partition.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.SampledRDD" class="extype" href="">SampledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValue" data-isabs="false"> + <a id="countByValue():Map[T, Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[T, <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[T, BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<span name="scala.collection.Map" class="extype">Map</span>[T, <a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#dependencies" data-isabs="false"> + <a id="dependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct():RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct(Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing the distinct elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#filter" data-isabs="false"> + <a id="filter((T) ⇒ Boolean):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: (T) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing only the elements that satisfy a predicate. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#first" data-isabs="false"> + <a id="first():T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#firstParent" data-isabs="false"> + <a id="firstParent[U](ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">firstParent</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Returns the first parent RDD</p><div class="fullcomment"><div class="comment cmt"><p>Returns the first parent RDD</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="spark" class="extype" href="../package.html">spark</a>] </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#flatMap" data-isabs="false"> + <a id="flatMap[U]((T) ⇒ TraversableOnce[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (T) ⇒ TraversableOnce[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#fold" data-isabs="false"> + <a id="fold(T)((T, T) ⇒ T):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: T</span>)</span><span class="params">(<span name="op">op: (T, T) ⇒ T</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#foreach" data-isabs="false"> + <a id="foreach((T) ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: (T) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getCheckpointFile" data-isabs="false"> + <a id="getCheckpointFile:Option[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCheckpointFile</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Gets the name of the file to which this RDD was checkpointed +</p><div class="fullcomment"><div class="comment cmt"><p>Gets the name of the file to which this RDD was checkpointed +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.RDD#getDependencies" data-isabs="false"> + <a id="getDependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getDependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return how this RDD depends on parent RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return how this RDD depends on parent RDDs. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.SampledRDD#getPartitions" data-isabs="false"> + <a id="getPartitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPartitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return the set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return the set of partitions in this RDD. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.SampledRDD" class="extype" href="">SampledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.SampledRDD#getPreferredLocations" data-isabs="false"> + <a id="getPreferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPreferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify placement preferences.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify placement preferences.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.SampledRDD" class="extype" href="">SampledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#glom" data-isabs="false"> + <a id="glom():RDD[Array[T]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[<span name="scala.Array" class="extype">Array</span>[T]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((T) ⇒ K,Partitioner)(ClassManifest[K]):RDD[(K, Seq[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[T])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((T) ⇒ K,Int)(ClassManifest[K]):RDD[(K, Seq[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[T])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((T) ⇒ K)(ClassManifest[K]):RDD[(K, Seq[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[T])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#isCheckpointed" data-isabs="false"> + <a id="isCheckpointed:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isCheckpointed</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return whether this RDD has been checkpointed or not +</p><div class="fullcomment"><div class="comment cmt"><p>Return whether this RDD has been checkpointed or not +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#iterator" data-isabs="false"> + <a id="iterator(Partition,TaskContext):Iterator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#keyBy" data-isabs="false"> + <a id="keyBy[K]((T) ⇒ K):RDD[(K, T)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, T)]</span> + </span> + </h4> + <p class="shortcomment cmt">Creates tuples of the elements in this RDD by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Creates tuples of the elements in this RDD by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#map" data-isabs="false"> + <a id="map[U]((T) ⇒ U)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (T) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U]((Iterator[T]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (Iterator[T]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitionsWithIndex" data-isabs="false"> + <a id="mapPartitionsWithIndex[U]((Int, Iterator[T]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitionsWithIndex</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[T]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#name" data-isabs="false"> + <a id="name:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">name</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A friendly name for this RDD</p><div class="fullcomment"><div class="comment cmt"><p>A friendly name for this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitioner" data-isabs="false"> + <a id="partitioner:Option[Partitioner]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitioner</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[<a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify how they are partitioned.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify how they are partitioned.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitions" data-isabs="false"> + <a id="partitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">partitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist():RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String],Map[String, String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>, <span name="env">env: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(String):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#preferredLocations" data-isabs="false"> + <a id="preferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#reduce" data-isabs="false"> + <a id="reduce((T, T) ⇒ T):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: (T, T) ⇒ T</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified commutative and associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified commutative and associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a sampled subset of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#setName" data-isabs="false"> + <a id="setName(String):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setName</span><span class="params">(<span name="_name">_name: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Assign a name to this RDD</p><div class="fullcomment"><div class="comment cmt"><p>Assign a name to this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[T],Partitioner):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[T],Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><p>Uses <code>this</code> partitioner/partition size, because even if <code>other</code> is huge, the resulting +RDD will be <= us. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#take" data-isabs="false"> + <a id="take(Int):Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toArray" data-isabs="false"> + <a id="toArray():Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toDebugString" data-isabs="false"> + <a id="toDebugString:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toDebugString</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A description of this RDD and its recursive dependencies for debugging.</p><div class="fullcomment"><div class="comment cmt"><p>A description of this RDD and its recursive dependencies for debugging.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#union" data-isabs="false"> + <a id="union(RDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#zip" data-isabs="false"> + <a id="zip[U](RDD[U])(ClassManifest[U]):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc.</p><div class="fullcomment"><div class="comment cmt"><p>Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc. Assumes that the two RDDs have the *same number of +partitions* and the *same number of elements in each partition* (e.g. one was made through +a map on the other). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="spark.RDD#mapPartitionsWithSplit" data-isabs="false"> + <a id="mapPartitionsWithSplit[U]((Int, Iterator[T]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version scala.this.deprecated.init$default$2) use mapPartitionsWithIndex">mapPartitionsWithSplit</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[T]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version scala.this.deprecated.init$default$2)</i> use mapPartitionsWithIndex</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="spark.RDD" class="parent"> + <h3>Inherited from <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</h3> + </div><div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/ShuffledAggregatedRDD.html b/site/docs/0.7.0/api/core/spark/rdd/ShuffledAggregatedRDD.html new file mode 100644 index 000000000..fe96fe03a --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/ShuffledAggregatedRDD.html @@ -0,0 +1,979 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.ShuffledAggregatedRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1>ShuffledAggregatedRDD</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">ShuffledAggregatedRDD</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>, <span name="C">C</span>]</span><span class="result"> extends <a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a>[K, V, C]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>The resulting RDD from shuffle and running (hash-based) aggregation. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a>[K, V, C], <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, C)], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.ShuffledAggregatedRDD" class="in"><span>ShuffledAggregatedRDD</span></li><li name="spark.rdd.ShuffledRDD" class="in"><span>ShuffledRDD</span></li><li name="spark.RDD" class="in"><span>RDD</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.rdd.ShuffledAggregatedRDD#this" data-isabs="false"> + <a id="this:ShuffledAggregatedRDD[K, V, C]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">ShuffledAggregatedRDD</span><span class="params">(<span name="parent">parent: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>, <span name="aggregator">aggregator: <a name="spark.Aggregator" class="extype" href="../Aggregator.html">Aggregator</a>[K, V, C]</span>, <span name="part">part: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#++" data-isabs="false"> + <a id="++(RDD[(K, C)]):RDD[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, C)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#aggregate" data-isabs="false"> + <a id="aggregate[U](U)((U, (K, C)) ⇒ U,(U, U) ⇒ U)(ClassManifest[U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: (U, (K, C)) ⇒ U</span>, <span name="combOp">combOp: (U, U) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cache" data-isabs="false"> + <a id="cache():RDD[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cartesian" data-isabs="false"> + <a id="cartesian[U](RDD[U])(ClassManifest[U]):RDD[((K, C), U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[((K, C), U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect():Array[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledAggregatedRDD#compute" data-isabs="false"> + <a id="compute(Split):Iterator[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compute</span><span class="params">(<span name="split">split: <a name="spark.Split" class="extype" href="../Split.html">Split</a></span>)</span><span class="result">: Iterator[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Function for computing a given partition.</p><div class="fullcomment"><div class="comment cmt"><p>Function for computing a given partition.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledAggregatedRDD" class="extype" href="">ShuffledAggregatedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValue" data-isabs="false"> + <a id="countByValue():Map[(K, C), Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[(K, C), <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[(K, C), BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<span name="scala.collection.Map" class="extype">Map</span>[(K, C), <a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#dep" data-isabs="false"> + <a id="dep:ShuffleDependency[K, V, C]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">dep</span><span class="result">: <a name="spark.ShuffleDependency" class="extype" href="../ShuffleDependency.html">ShuffleDependency</a>[K, V, C]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#dependencies" data-isabs="false"> + <a id="dependencies:List[ShuffleDependency[K, V, C]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">dependencies</span><span class="result">: <span name="scala.collection.immutable.List" class="extype">List</span>[<a name="spark.ShuffleDependency" class="extype" href="../ShuffleDependency.html">ShuffleDependency</a>[K, V, C]]</span> + </span> + </h4> + <p class="shortcomment cmt">How this RDD depends on any parent RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>How this RDD depends on any parent RDDs.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct(Int):RDD[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numSplits">numSplits: <span name="scala.Int" class="extype">Int</span> = <span class="symbol"><span class="name"><a href="../RDD.html#splits:Array[Split]">splits.size</a></span></span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing the distinct elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#filter" data-isabs="false"> + <a id="filter(((K, C)) ⇒ Boolean):RDD[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: ((K, C)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing only the elements that satisfy a predicate. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#first" data-isabs="false"> + <a id="first():(K, C)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: (K, C)</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#flatMap" data-isabs="false"> + <a id="flatMap[U](((K, C)) ⇒ TraversableOnce[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((K, C)) ⇒ TraversableOnce[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#fold" data-isabs="false"> + <a id="fold((K, C))(((K, C), (K, C)) ⇒ (K, C)):(K, C)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: (K, C)</span>)</span><span class="params">(<span name="op">op: ((K, C), (K, C)) ⇒ (K, C)</span>)</span><span class="result">: (K, C)</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#foreach" data-isabs="false"> + <a id="foreach(((K, C)) ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: ((K, C)) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#glom" data-isabs="false"> + <a id="glom():RDD[Array[(K, C)]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[<span name="scala.Array" class="extype">Array</span>[(K, C)]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, C)) ⇒ K)(ClassManifest[K]):RDD[(K, Seq[(K, C)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, C)) ⇒ K</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, C)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, C)) ⇒ K,Int)(ClassManifest[K]):RDD[(K, Seq[(K, C)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, C)) ⇒ K</span>, <span name="numSplits">numSplits: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, C)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#iterator" data-isabs="false"> + <a id="iterator(Split):Iterator[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Split" class="extype" href="../Split.html">Split</a></span>)</span><span class="result">: Iterator[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#map" data-isabs="false"> + <a id="map[U](((K, C)) ⇒ U)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((K, C)) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U]((Iterator[(K, C)]) ⇒ Iterator[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (Iterator[(K, C)]) ⇒ Iterator[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitionsWithSplit" data-isabs="false"> + <a id="mapPartitionsWithSplit[U]((Int, Iterator[(K, C)]) ⇒ Iterator[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitionsWithSplit</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[(K, C)]) ⇒ Iterator[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#partitioner" data-isabs="false"> + <a id="partitioner:Some[Partitioner]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitioner</span><span class="result">: <span name="scala.Some" class="extype">Some</span>[<a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify how they are partitioned.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify how they are partitioned.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist():RDD[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):RDD[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String],Map[String, String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>, <span name="env">env: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(String):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#preferredLocations" data-isabs="false"> + <a id="preferredLocations(Split):scala.collection.immutable.Nil.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Split" class="extype" href="../Split.html">Split</a></span>)</span><span class="result">: scala.collection.immutable.Nil.type</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify placement preferences.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify placement preferences.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#reduce" data-isabs="false"> + <a id="reduce(((K, C), (K, C)) ⇒ (K, C)):(K, C)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: ((K, C), (K, C)) ⇒ (K, C)</span>)</span><span class="result">: (K, C)</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):RDD[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a sampled subset of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#splits" data-isabs="false"> + <a id="splits:Array[Split]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">splits</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Split" class="extype" href="../Split.html">Split</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Set of partitions in this RDD.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#splits_" data-isabs="false"> + <a id="splits_:Array[Split]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">splits_</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Split" class="extype" href="../Split.html">Split</a>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#take" data-isabs="false"> + <a id="take(Int):Array[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):Array[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, C)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toArray" data-isabs="false"> + <a id="toArray():Array[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#union" data-isabs="false"> + <a id="union(RDD[(K, C)]):RDD[(K, C)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, C)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, C)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.rdd.ShuffledRDD" class="parent"> + <h3>Inherited from <a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a>[K, V, C]</h3> + </div><div name="spark.RDD" class="parent"> + <h3>Inherited from <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, C)]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/ShuffledRDD.html b/site/docs/0.7.0/api/core/spark/rdd/ShuffledRDD.html new file mode 100644 index 000000000..178c1c841 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/ShuffledRDD.html @@ -0,0 +1,1399 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.ShuffledRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1>ShuffledRDD</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">ShuffledRDD</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>The resulting RDD from a shuffle (e.g. repartitioning of data).</p></div><dl class="paramcmts block"><dt class="tparam">K</dt><dd class="cmt"><p>the key class.</p></dd><dt class="tparam">V</dt><dd class="cmt"><p>the value class. +</p></dd></dl><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)], <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a>, <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.ShuffledRDD" class="in"><span>ShuffledRDD</span></li><li name="spark.RDD" class="in"><span>RDD</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.rdd.ShuffledRDD#this" data-isabs="false"> + <a id="this:ShuffledRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">ShuffledRDD</span><span class="params">(<span name="prev">prev: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>, <span name="part">part: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span> + </span> + </h4> + <p class="shortcomment cmt"></p><div class="fullcomment"><div class="comment cmt"></div><dl class="paramcmts block"><dt class="param">prev</dt><dd class="cmt"><p>the parent RDD.</p></dd><dt class="param">part</dt><dd class="cmt"><p>the partitioner used to partition the RDD</p></dd></dl></div> + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#++" data-isabs="false"> + <a id="++(RDD[(K, V)]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#aggregate" data-isabs="false"> + <a id="aggregate[U](U)((U, (K, V)) ⇒ U,(U, U) ⇒ U)(ClassManifest[U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: (U, (K, V)) ⇒ U</span>, <span name="combOp">combOp: (U, U) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cache" data-isabs="false"> + <a id="cache():RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cartesian" data-isabs="false"> + <a id="cartesian[U](RDD[U])(ClassManifest[U]):RDD[((K, V), U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[((K, V), U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#checkpoint" data-isabs="false"> + <a id="checkpoint():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpoint</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Mark this RDD for checkpointing.</p><div class="fullcomment"><div class="comment cmt"><p>Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint +directory set with SparkContext.setCheckpointDir() and all references to its parent +RDDs will be removed. This function must be called before any job has been +executed on this RDD. It is strongly recommended that this RDD is persisted in +memory, otherwise saving it on a file will require recomputation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#clearDependencies" data-isabs="false"> + <a id="clearDependencies():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearDependencies</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Clears the dependencies of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Clears the dependencies of this RDD. This method must ensure that all references +to the original parent RDDs is removed to enable the parent RDDs to be garbage +collected. Subclasses of RDD may override this method for implementing their own cleaning +logic. See <a name="spark.rdd.UnionRDD" class="extype" href="UnionRDD.html">UnionRDD</a> for an example. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#coalesce" data-isabs="false"> + <a id="coalesce(Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">coalesce</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD that is reduced into <code>numPartitions</code> partitions.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD that is reduced into <code>numPartitions</code> partitions. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect[U](PartialFunction[(K, V), U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[(K, V), U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD that contains all matching values by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD that contains all matching values by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect():Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#compute" data-isabs="false"> + <a id="compute(Partition,TaskContext):Iterator[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compute</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to compute a given partition.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to compute a given partition.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="">ShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValue" data-isabs="false"> + <a id="countByValue():Map[(K, V), Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[(K, V), <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[(K, V), BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<span name="scala.collection.Map" class="extype">Map</span>[(K, V), <a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#dependencies" data-isabs="false"> + <a id="dependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct():RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct(Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing the distinct elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#filter" data-isabs="false"> + <a id="filter(((K, V)) ⇒ Boolean):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: ((K, V)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing only the elements that satisfy a predicate. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#first" data-isabs="false"> + <a id="first():(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#firstParent" data-isabs="false"> + <a id="firstParent[U](ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">firstParent</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Returns the first parent RDD</p><div class="fullcomment"><div class="comment cmt"><p>Returns the first parent RDD</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="spark" class="extype" href="../package.html">spark</a>] </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#flatMap" data-isabs="false"> + <a id="flatMap[U](((K, V)) ⇒ TraversableOnce[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ TraversableOnce[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#fold" data-isabs="false"> + <a id="fold((K, V))(((K, V), (K, V)) ⇒ (K, V)):(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: (K, V)</span>)</span><span class="params">(<span name="op">op: ((K, V), (K, V)) ⇒ (K, V)</span>)</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#foreach" data-isabs="false"> + <a id="foreach(((K, V)) ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: ((K, V)) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getCheckpointFile" data-isabs="false"> + <a id="getCheckpointFile:Option[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCheckpointFile</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Gets the name of the file to which this RDD was checkpointed +</p><div class="fullcomment"><div class="comment cmt"><p>Gets the name of the file to which this RDD was checkpointed +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.RDD#getDependencies" data-isabs="false"> + <a id="getDependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getDependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return how this RDD depends on parent RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return how this RDD depends on parent RDDs. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#getPartitions" data-isabs="false"> + <a id="getPartitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPartitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return the set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return the set of partitions in this RDD. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="">ShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#getPreferredLocations" data-isabs="false"> + <a id="getPreferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPreferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify placement preferences.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify placement preferences.</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#glom" data-isabs="false"> + <a id="glom():RDD[Array[(K, V)]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[<span name="scala.Array" class="extype">Array</span>[(K, V)]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, V)) ⇒ K,Partitioner)(ClassManifest[K]):RDD[(K, Seq[(K, V)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, V)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, V)) ⇒ K,Int)(ClassManifest[K]):RDD[(K, Seq[(K, V)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, V)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, V)) ⇒ K)(ClassManifest[K]):RDD[(K, Seq[(K, V)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, V)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#isCheckpointed" data-isabs="false"> + <a id="isCheckpointed:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isCheckpointed</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return whether this RDD has been checkpointed or not +</p><div class="fullcomment"><div class="comment cmt"><p>Return whether this RDD has been checkpointed or not +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#iterator" data-isabs="false"> + <a id="iterator(Partition,TaskContext):Iterator[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#keyBy" data-isabs="false"> + <a id="keyBy[K](((K, V)) ⇒ K):RDD[(K, (K, V))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, (K, V))]</span> + </span> + </h4> + <p class="shortcomment cmt">Creates tuples of the elements in this RDD by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Creates tuples of the elements in this RDD by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#map" data-isabs="false"> + <a id="map[U](((K, V)) ⇒ U)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U]((Iterator[(K, V)]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (Iterator[(K, V)]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitionsWithIndex" data-isabs="false"> + <a id="mapPartitionsWithIndex[U]((Int, Iterator[(K, V)]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitionsWithIndex</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[(K, V)]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#name" data-isabs="false"> + <a id="name:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">name</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A friendly name for this RDD</p><div class="fullcomment"><div class="comment cmt"><p>A friendly name for this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#partitioner" data-isabs="false"> + <a id="partitioner:Some[Partitioner]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitioner</span><span class="result">: <span name="scala.Some" class="extype">Some</span>[<a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify how they are partitioned.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify how they are partitioned.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="">ShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitions" data-isabs="false"> + <a id="partitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">partitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist():RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String],Map[String, String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>, <span name="env">env: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(String):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#preferredLocations" data-isabs="false"> + <a id="preferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#reduce" data-isabs="false"> + <a id="reduce(((K, V), (K, V)) ⇒ (K, V)):(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: ((K, V), (K, V)) ⇒ (K, V)</span>)</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified commutative and associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified commutative and associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a sampled subset of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#setName" data-isabs="false"> + <a id="setName(String):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setName</span><span class="params">(<span name="_name">_name: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Assign a name to this RDD</p><div class="fullcomment"><div class="comment cmt"><p>Assign a name to this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[(K, V)],Partitioner):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[(K, V)],Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[(K, V)]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><p>Uses <code>this</code> partitioner/partition size, because even if <code>other</code> is huge, the resulting +RDD will be <= us. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#take" data-isabs="false"> + <a id="take(Int):Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toArray" data-isabs="false"> + <a id="toArray():Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toDebugString" data-isabs="false"> + <a id="toDebugString:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toDebugString</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A description of this RDD and its recursive dependencies for debugging.</p><div class="fullcomment"><div class="comment cmt"><p>A description of this RDD and its recursive dependencies for debugging.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#union" data-isabs="false"> + <a id="union(RDD[(K, V)]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#zip" data-isabs="false"> + <a id="zip[U](RDD[U])(ClassManifest[U]):RDD[((K, V), U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[((K, V), U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc.</p><div class="fullcomment"><div class="comment cmt"><p>Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc. Assumes that the two RDDs have the *same number of +partitions* and the *same number of elements in each partition* (e.g. one was made through +a map on the other). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="spark.RDD#mapPartitionsWithSplit" data-isabs="false"> + <a id="mapPartitionsWithSplit[U]((Int, Iterator[(K, V)]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version scala.this.deprecated.init$default$2) use mapPartitionsWithIndex">mapPartitionsWithSplit</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[(K, V)]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version scala.this.deprecated.init$default$2)</i> use mapPartitionsWithIndex</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="spark.RDD" class="parent"> + <h3>Inherited from <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</h3> + </div><div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/ShuffledSortedRDD.html b/site/docs/0.7.0/api/core/spark/rdd/ShuffledSortedRDD.html new file mode 100644 index 000000000..bbe0dbfc6 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/ShuffledSortedRDD.html @@ -0,0 +1,982 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.ShuffledSortedRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1>ShuffledSortedRDD</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">ShuffledSortedRDD</span><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends <a name="spark.rdd.RepartitionShuffledRDD" class="extype" href="RepartitionShuffledRDD.html">RepartitionShuffledRDD</a>[K, V]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A sort-based shuffle (that doesn't apply aggregation). It does so by first +repartitioning the RDD by range, and then sort within each range. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.rdd.RepartitionShuffledRDD" class="extype" href="RepartitionShuffledRDD.html">RepartitionShuffledRDD</a>[K, V], <a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a>[K, V, V], <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.ShuffledSortedRDD" class="in"><span>ShuffledSortedRDD</span></li><li name="spark.rdd.RepartitionShuffledRDD" class="in"><span>RepartitionShuffledRDD</span></li><li name="spark.rdd.ShuffledRDD" class="in"><span>ShuffledRDD</span></li><li name="spark.RDD" class="in"><span>RDD</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.rdd.ShuffledSortedRDD#this" data-isabs="false"> + <a id="this:ShuffledSortedRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">ShuffledSortedRDD</span><span class="params">(<span name="parent">parent: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>, <span name="ascending">ascending: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="numSplits">numSplits: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: (K) ⇒ Ordered[K]</span>, <span name="arg1">arg1: ClassManifest[K]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#++" data-isabs="false"> + <a id="++(RDD[(K, V)]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#aggregate" data-isabs="false"> + <a id="aggregate[U](U)((U, (K, V)) ⇒ U,(U, U) ⇒ U)(ClassManifest[U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: (U, (K, V)) ⇒ U</span>, <span name="combOp">combOp: (U, U) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cache" data-isabs="false"> + <a id="cache():RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cartesian" data-isabs="false"> + <a id="cartesian[U](RDD[U])(ClassManifest[U]):RDD[((K, V), U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[((K, V), U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect():Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledSortedRDD#compute" data-isabs="false"> + <a id="compute(Split):Iterator[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compute</span><span class="params">(<span name="split">split: <a name="spark.Split" class="extype" href="../Split.html">Split</a></span>)</span><span class="result">: Iterator[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Function for computing a given partition.</p><div class="fullcomment"><div class="comment cmt"><p>Function for computing a given partition.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledSortedRDD" class="extype" href="">ShuffledSortedRDD</a> → <a name="spark.rdd.RepartitionShuffledRDD" class="extype" href="RepartitionShuffledRDD.html">RepartitionShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValue" data-isabs="false"> + <a id="countByValue():Map[(K, V), Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[(K, V), <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[(K, V), BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<span name="scala.collection.Map" class="extype">Map</span>[(K, V), <a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#dep" data-isabs="false"> + <a id="dep:ShuffleDependency[K, V, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">dep</span><span class="result">: <a name="spark.ShuffleDependency" class="extype" href="../ShuffleDependency.html">ShuffleDependency</a>[K, V, V]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#dependencies" data-isabs="false"> + <a id="dependencies:List[ShuffleDependency[K, V, V]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">dependencies</span><span class="result">: <span name="scala.collection.immutable.List" class="extype">List</span>[<a name="spark.ShuffleDependency" class="extype" href="../ShuffleDependency.html">ShuffleDependency</a>[K, V, V]]</span> + </span> + </h4> + <p class="shortcomment cmt">How this RDD depends on any parent RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>How this RDD depends on any parent RDDs.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct(Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numSplits">numSplits: <span name="scala.Int" class="extype">Int</span> = <span class="symbol"><span class="name"><a href="../RDD.html#splits:Array[Split]">splits.size</a></span></span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing the distinct elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#filter" data-isabs="false"> + <a id="filter(((K, V)) ⇒ Boolean):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: ((K, V)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing only the elements that satisfy a predicate. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#first" data-isabs="false"> + <a id="first():(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#flatMap" data-isabs="false"> + <a id="flatMap[U](((K, V)) ⇒ TraversableOnce[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ TraversableOnce[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#fold" data-isabs="false"> + <a id="fold((K, V))(((K, V), (K, V)) ⇒ (K, V)):(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: (K, V)</span>)</span><span class="params">(<span name="op">op: ((K, V), (K, V)) ⇒ (K, V)</span>)</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#foreach" data-isabs="false"> + <a id="foreach(((K, V)) ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: ((K, V)) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#glom" data-isabs="false"> + <a id="glom():RDD[Array[(K, V)]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[<span name="scala.Array" class="extype">Array</span>[(K, V)]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, V)) ⇒ K)(ClassManifest[K]):RDD[(K, Seq[(K, V)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, V)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((K, V)) ⇒ K,Int)(ClassManifest[K]):RDD[(K, Seq[(K, V)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ K</span>, <span name="numSplits">numSplits: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(K, V)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#iterator" data-isabs="false"> + <a id="iterator(Split):Iterator[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Split" class="extype" href="../Split.html">Split</a></span>)</span><span class="result">: Iterator[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#map" data-isabs="false"> + <a id="map[U](((K, V)) ⇒ U)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((K, V)) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U]((Iterator[(K, V)]) ⇒ Iterator[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (Iterator[(K, V)]) ⇒ Iterator[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitionsWithSplit" data-isabs="false"> + <a id="mapPartitionsWithSplit[U]((Int, Iterator[(K, V)]) ⇒ Iterator[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitionsWithSplit</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[(K, V)]) ⇒ Iterator[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#partitioner" data-isabs="false"> + <a id="partitioner:Some[Partitioner]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitioner</span><span class="result">: <span name="scala.Some" class="extype">Some</span>[<a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify how they are partitioned.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify how they are partitioned.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist():RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String],Map[String, String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>, <span name="env">env: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(String):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#preferredLocations" data-isabs="false"> + <a id="preferredLocations(Split):scala.collection.immutable.Nil.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Split" class="extype" href="../Split.html">Split</a></span>)</span><span class="result">: scala.collection.immutable.Nil.type</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify placement preferences.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify placement preferences.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#reduce" data-isabs="false"> + <a id="reduce(((K, V), (K, V)) ⇒ (K, V)):(K, V)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: ((K, V), (K, V)) ⇒ (K, V)</span>)</span><span class="result">: (K, V)</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a sampled subset of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#splits" data-isabs="false"> + <a id="splits:Array[Split]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">splits</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Split" class="extype" href="../Split.html">Split</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Set of partitions in this RDD.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ShuffledRDD#splits_" data-isabs="false"> + <a id="splits_:Array[Split]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">splits_</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Split" class="extype" href="../Split.html">Split</a>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#take" data-isabs="false"> + <a id="take(Int):Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toArray" data-isabs="false"> + <a id="toArray():Array[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#union" data-isabs="false"> + <a id="union(RDD[(K, V)]):RDD[(K, V)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.rdd.RepartitionShuffledRDD" class="parent"> + <h3>Inherited from <a name="spark.rdd.RepartitionShuffledRDD" class="extype" href="RepartitionShuffledRDD.html">RepartitionShuffledRDD</a>[K, V]</h3> + </div><div name="spark.rdd.ShuffledRDD" class="parent"> + <h3>Inherited from <a name="spark.rdd.ShuffledRDD" class="extype" href="ShuffledRDD.html">ShuffledRDD</a>[K, V, V]</h3> + </div><div name="spark.RDD" class="parent"> + <h3>Inherited from <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, V)]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/UnionRDD.html b/site/docs/0.7.0/api/core/spark/rdd/UnionRDD.html new file mode 100644 index 000000000..6f7d87f1f --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/UnionRDD.html @@ -0,0 +1,1410 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.UnionRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1>UnionRDD</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">UnionRDD</span><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T], <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a>, <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.UnionRDD" class="in"><span>UnionRDD</span></li><li name="spark.RDD" class="in"><span>RDD</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.rdd.UnionRDD#this" data-isabs="false"> + <a id="this:UnionRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">UnionRDD</span><span class="params">(<span name="sc">sc: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span>, <span name="rdds">rdds: Seq[<a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#++" data-isabs="false"> + <a id="++(RDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#aggregate" data-isabs="false"> + <a id="aggregate[U](U)((U, T) ⇒ U,(U, U) ⇒ U)(ClassManifest[U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: (U, T) ⇒ U</span>, <span name="combOp">combOp: (U, U) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cache" data-isabs="false"> + <a id="cache():RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cartesian" data-isabs="false"> + <a id="cartesian[U](RDD[U])(ClassManifest[U]):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#checkpoint" data-isabs="false"> + <a id="checkpoint():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpoint</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Mark this RDD for checkpointing.</p><div class="fullcomment"><div class="comment cmt"><p>Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint +directory set with SparkContext.setCheckpointDir() and all references to its parent +RDDs will be removed. This function must be called before any job has been +executed on this RDD. It is strongly recommended that this RDD is persisted in +memory, otherwise saving it on a file will require recomputation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#clearDependencies" data-isabs="false"> + <a id="clearDependencies():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearDependencies</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Clears the dependencies of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Clears the dependencies of this RDD. This method must ensure that all references +to the original parent RDDs is removed to enable the parent RDDs to be garbage +collected. Subclasses of RDD may override this method for implementing their own cleaning +logic. See <a name="spark.rdd.UnionRDD" class="extype" href="">UnionRDD</a> for an example. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#coalesce" data-isabs="false"> + <a id="coalesce(Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">coalesce</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD that is reduced into <code>numPartitions</code> partitions.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD that is reduced into <code>numPartitions</code> partitions. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect[U](PartialFunction[T, U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[T, U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD that contains all matching values by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD that contains all matching values by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect():Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.UnionRDD#compute" data-isabs="false"> + <a id="compute(Partition,TaskContext):Iterator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compute</span><span class="params">(<span name="s">s: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to compute a given partition.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to compute a given partition.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.UnionRDD" class="extype" href="">UnionRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValue" data-isabs="false"> + <a id="countByValue():Map[T, Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[T, <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[T, BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<span name="scala.collection.Map" class="extype">Map</span>[T, <a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#dependencies" data-isabs="false"> + <a id="dependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct():RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct(Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing the distinct elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#filter" data-isabs="false"> + <a id="filter((T) ⇒ Boolean):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: (T) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing only the elements that satisfy a predicate. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#first" data-isabs="false"> + <a id="first():T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#firstParent" data-isabs="false"> + <a id="firstParent[U](ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">firstParent</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Returns the first parent RDD</p><div class="fullcomment"><div class="comment cmt"><p>Returns the first parent RDD</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="spark" class="extype" href="../package.html">spark</a>] </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#flatMap" data-isabs="false"> + <a id="flatMap[U]((T) ⇒ TraversableOnce[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (T) ⇒ TraversableOnce[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#fold" data-isabs="false"> + <a id="fold(T)((T, T) ⇒ T):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: T</span>)</span><span class="params">(<span name="op">op: (T, T) ⇒ T</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#foreach" data-isabs="false"> + <a id="foreach((T) ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: (T) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getCheckpointFile" data-isabs="false"> + <a id="getCheckpointFile:Option[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCheckpointFile</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Gets the name of the file to which this RDD was checkpointed +</p><div class="fullcomment"><div class="comment cmt"><p>Gets the name of the file to which this RDD was checkpointed +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.rdd.UnionRDD#getDependencies" data-isabs="false"> + <a id="getDependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getDependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return how this RDD depends on parent RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return how this RDD depends on parent RDDs. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.UnionRDD" class="extype" href="">UnionRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.UnionRDD#getPartitions" data-isabs="false"> + <a id="getPartitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPartitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return the set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return the set of partitions in this RDD. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.UnionRDD" class="extype" href="">UnionRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.UnionRDD#getPreferredLocations" data-isabs="false"> + <a id="getPreferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPreferredLocations</span><span class="params">(<span name="s">s: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify placement preferences.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify placement preferences.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.UnionRDD" class="extype" href="">UnionRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#glom" data-isabs="false"> + <a id="glom():RDD[Array[T]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[<span name="scala.Array" class="extype">Array</span>[T]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((T) ⇒ K,Partitioner)(ClassManifest[K]):RDD[(K, Seq[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[T])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((T) ⇒ K,Int)(ClassManifest[K]):RDD[(K, Seq[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[T])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K]((T) ⇒ K)(ClassManifest[K]):RDD[(K, Seq[T])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[T])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#isCheckpointed" data-isabs="false"> + <a id="isCheckpointed:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isCheckpointed</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return whether this RDD has been checkpointed or not +</p><div class="fullcomment"><div class="comment cmt"><p>Return whether this RDD has been checkpointed or not +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#iterator" data-isabs="false"> + <a id="iterator(Partition,TaskContext):Iterator[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#keyBy" data-isabs="false"> + <a id="keyBy[K]((T) ⇒ K):RDD[(K, T)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (T) ⇒ K</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, T)]</span> + </span> + </h4> + <p class="shortcomment cmt">Creates tuples of the elements in this RDD by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Creates tuples of the elements in this RDD by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#map" data-isabs="false"> + <a id="map[U]((T) ⇒ U)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (T) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U]((Iterator[T]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (Iterator[T]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitionsWithIndex" data-isabs="false"> + <a id="mapPartitionsWithIndex[U]((Int, Iterator[T]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitionsWithIndex</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[T]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#name" data-isabs="false"> + <a id="name:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">name</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A friendly name for this RDD</p><div class="fullcomment"><div class="comment cmt"><p>A friendly name for this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitioner" data-isabs="false"> + <a id="partitioner:Option[Partitioner]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitioner</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[<a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify how they are partitioned.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify how they are partitioned.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitions" data-isabs="false"> + <a id="partitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">partitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist():RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String],Map[String, String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>, <span name="env">env: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(String):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#preferredLocations" data-isabs="false"> + <a id="preferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.UnionRDD#rdds" data-isabs="false"> + <a id="rdds:Seq[RDD[T]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">rdds</span><span class="result">: Seq[<a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.RDD#reduce" data-isabs="false"> + <a id="reduce((T, T) ⇒ T):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: (T, T) ⇒ T</span>)</span><span class="result">: T</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified commutative and associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified commutative and associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a sampled subset of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#setName" data-isabs="false"> + <a id="setName(String):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setName</span><span class="params">(<span name="_name">_name: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Assign a name to this RDD</p><div class="fullcomment"><div class="comment cmt"><p>Assign a name to this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[T],Partitioner):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[T],Int):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><p>Uses <code>this</code> partitioner/partition size, because even if <code>other</code> is huge, the resulting +RDD will be <= us. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#take" data-isabs="false"> + <a id="take(Int):Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toArray" data-isabs="false"> + <a id="toArray():Array[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toDebugString" data-isabs="false"> + <a id="toDebugString:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toDebugString</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A description of this RDD and its recursive dependencies for debugging.</p><div class="fullcomment"><div class="comment cmt"><p>A description of this RDD and its recursive dependencies for debugging.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#union" data-isabs="false"> + <a id="union(RDD[T]):RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#zip" data-isabs="false"> + <a id="zip[U](RDD[U])(ClassManifest[U]):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc.</p><div class="fullcomment"><div class="comment cmt"><p>Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc. Assumes that the two RDDs have the *same number of +partitions* and the *same number of elements in each partition* (e.g. one was made through +a map on the other). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="spark.RDD#mapPartitionsWithSplit" data-isabs="false"> + <a id="mapPartitionsWithSplit[U]((Int, Iterator[T]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version scala.this.deprecated.init$default$2) use mapPartitionsWithIndex">mapPartitionsWithSplit</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[T]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version scala.this.deprecated.init$default$2)</i> use mapPartitionsWithIndex</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="spark.RDD" class="parent"> + <h3>Inherited from <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</h3> + </div><div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/ZippedRDD.html b/site/docs/0.7.0/api/core/spark/rdd/ZippedRDD.html new file mode 100644 index 000000000..8f6f802f2 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/ZippedRDD.html @@ -0,0 +1,1422 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd.ZippedRDD</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.rdd" class="extype" href="package.html">rdd</a></p> + <h1>ZippedRDD</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">ZippedRDD</span><span class="tparams">[<span name="T">T</span>, <span name="U">U</span>]</span><span class="result"> extends <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)], <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a>, <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.rdd.ZippedRDD" class="in"><span>ZippedRDD</span></li><li name="spark.RDD" class="in"><span>RDD</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.rdd.ZippedRDD#this" data-isabs="false"> + <a id="this:ZippedRDD[T, U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">ZippedRDD</span><span class="params">(<span name="sc">sc: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span>, <span name="rdd1">rdd1: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span>, <span name="rdd2">rdd2: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[T]</span>, <span name="arg1">arg1: ClassManifest[U]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#++" data-isabs="false"> + <a id="++(RDD[(T, U)]):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#aggregate" data-isabs="false"> + <a id="aggregate[U](U)((U, (T, U)) ⇒ U,(U, U) ⇒ U)(ClassManifest[U]):U"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="zeroValue">zeroValue: U</span>)</span><span class="params">(<span name="seqOp">seqOp: (U, (T, U)) ⇒ U</span>, <span name="combOp">combOp: (U, U) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: U</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using +given combine functions and a neutral "zero value". This function can return a different result +type, U, than the type of this RDD, T. Thus, we need one operation for merging a T into an U +and one operation for merging two U's, as in scala.TraversableOnce. Both of these functions are +allowed to modify and return their first argument instead of creating a new U to avoid memory +allocation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cache" data-isabs="false"> + <a id="cache():RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cache</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#cartesian" data-isabs="false"> + <a id="cartesian[U](RDD[U])(ClassManifest[U]):RDD[((T, U), U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cartesian</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[((T, U), U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return the Cartesian product of this RDD and another one, that is, the RDD of all pairs of +elements (a, b) where a is in <code>this</code> and b is in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#checkpoint" data-isabs="false"> + <a id="checkpoint():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">checkpoint</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Mark this RDD for checkpointing.</p><div class="fullcomment"><div class="comment cmt"><p>Mark this RDD for checkpointing. It will be saved to a file inside the checkpoint +directory set with SparkContext.setCheckpointDir() and all references to its parent +RDDs will be removed. This function must be called before any job has been +executed on this RDD. It is strongly recommended that this RDD is persisted in +memory, otherwise saving it on a file will require recomputation. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ZippedRDD#clearDependencies" data-isabs="false"> + <a id="clearDependencies():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearDependencies</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Clears the dependencies of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Clears the dependencies of this RDD. This method must ensure that all references +to the original parent RDDs is removed to enable the parent RDDs to be garbage +collected. Subclasses of RDD may override this method for implementing their own cleaning +logic. See <a name="spark.rdd.UnionRDD" class="extype" href="UnionRDD.html">UnionRDD</a> for an example. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ZippedRDD" class="extype" href="">ZippedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#coalesce" data-isabs="false"> + <a id="coalesce(Int):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">coalesce</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD that is reduced into <code>numPartitions</code> partitions.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD that is reduced into <code>numPartitions</code> partitions. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect[U](PartialFunction[(T, U), U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[(T, U), U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD that contains all matching values by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD that contains all matching values by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#collect" data-isabs="false"> + <a id="collect():Array[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ZippedRDD#compute" data-isabs="false"> + <a id="compute(Partition,TaskContext):Iterator[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compute</span><span class="params">(<span name="s">s: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to compute a given partition.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to compute a given partition.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ZippedRDD" class="extype" href="">ZippedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#context" data-isabs="false"> + <a id="context:SparkContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a></span> + </span> + </h4> + <p class="shortcomment cmt">The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p><div class="fullcomment"><div class="comment cmt"><p>The <a name="spark.SparkContext" class="extype" href="../SparkContext.html">SparkContext</a> that this RDD was created on.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#count" data-isabs="false"> + <a id="count():Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">()</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the number of elements in the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the number of elements in the RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countApprox" data-isabs="false"> + <a id="countApprox(Long,Double):PartialResult[BoundedDouble]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished.</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of count() that returns a potentially incomplete result +within a timeout, even if not all tasks have finished. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValue" data-isabs="false"> + <a id="countByValue():Map[(T, U), Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValue</span><span class="params">()</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[(T, U), <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the count of each unique value in this RDD as a map of (value, count) pairs.</p><div class="fullcomment"><div class="comment cmt"><p>Return the count of each unique value in this RDD as a map of (value, count) pairs. The final +combine step happens locally on the master, equivalent to running a single reduce task. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#countByValueApprox" data-isabs="false"> + <a id="countByValueApprox(Long,Double):PartialResult[Map[(T, U), BoundedDouble]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">countByValueApprox</span><span class="params">(<span name="timeout">timeout: <span name="scala.Long" class="extype">Long</span></span>, <span name="confidence">confidence: <span name="scala.Double" class="extype">Double</span> = <span class="symbol">0.95</span></span>)</span><span class="result">: <a name="spark.partial.PartialResult" class="extype" href="../partial/PartialResult.html">PartialResult</a>[<span name="scala.collection.Map" class="extype">Map</span>[(T, U), <a name="spark.partial.BoundedDouble" class="extype" href="../partial/BoundedDouble.html">BoundedDouble</a>]]</span> + </span> + </h4> + <p class="shortcomment cmt">(Experimental) Approximate version of countByValue().</p><div class="fullcomment"><div class="comment cmt"><p>(Experimental) Approximate version of countByValue(). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#dependencies" data-isabs="false"> + <a id="dependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the list of dependencies of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct():RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#distinct" data-isabs="false"> + <a id="distinct(Int):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">distinct</span><span class="params">(<span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing the distinct elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing the distinct elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#filter" data-isabs="false"> + <a id="filter(((T, U)) ⇒ Boolean):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="f">f: ((T, U)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD containing only the elements that satisfy a predicate.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD containing only the elements that satisfy a predicate. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#first" data-isabs="false"> + <a id="first():(T, U)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">first</span><span class="params">()</span><span class="result">: (T, U)</span> + </span> + </h4> + <p class="shortcomment cmt">Return the first element in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return the first element in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.RDD#firstParent" data-isabs="false"> + <a id="firstParent[U](ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">firstParent</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Returns the first parent RDD</p><div class="fullcomment"><div class="comment cmt"><p>Returns the first parent RDD</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="spark" class="extype" href="../package.html">spark</a>] </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#flatMap" data-isabs="false"> + <a id="flatMap[U](((T, U)) ⇒ TraversableOnce[U])(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((T, U)) ⇒ TraversableOnce[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt"> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results.</p><div class="fullcomment"><div class="comment cmt"><p> Return a new RDD by first applying a function to all elements of this + RDD, and then flattening the results. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#fold" data-isabs="false"> + <a id="fold((T, U))(((T, U), (T, U)) ⇒ (T, U)):(T, U)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="params">(<span name="zeroValue">zeroValue: (T, U)</span>)</span><span class="params">(<span name="op">op: ((T, U), (T, U)) ⇒ (T, U)</span>)</span><span class="result">: (T, U)</span> + </span> + </h4> + <p class="shortcomment cmt">Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value".</p><div class="fullcomment"><div class="comment cmt"><p>Aggregate the elements of each partition, and then the results for all the partitions, using a +given associative function and a neutral "zero value". The function op(t1, t2) is allowed to +modify t1 and return it as its result value to avoid object allocation; however, it should not +modify t2. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#foreach" data-isabs="false"> + <a id="foreach(((T, U)) ⇒ Unit):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="params">(<span name="f">f: ((T, U)) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Applies a function f to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Applies a function f to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getCheckpointFile" data-isabs="false"> + <a id="getCheckpointFile:Option[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getCheckpointFile</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Gets the name of the file to which this RDD was checkpointed +</p><div class="fullcomment"><div class="comment cmt"><p>Gets the name of the file to which this RDD was checkpointed +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.RDD#getDependencies" data-isabs="false"> + <a id="getDependencies:Seq[spark.Dependency[_]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getDependencies</span><span class="result">: Seq[spark.Dependency[_]]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return how this RDD depends on parent RDDs.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return how this RDD depends on parent RDDs. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ZippedRDD#getPartitions" data-isabs="false"> + <a id="getPartitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPartitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Implemented by subclasses to return the set of partitions in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Implemented by subclasses to return the set of partitions in this RDD. This method will only +be called once, so it is safe to implement a time-consuming computation in it. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ZippedRDD" class="extype" href="">ZippedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ZippedRDD#getPreferredLocations" data-isabs="false"> + <a id="getPreferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getPreferredLocations</span><span class="params">(<span name="s">s: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify placement preferences.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify placement preferences.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.rdd.ZippedRDD" class="extype" href="">ZippedRDD</a> → <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#getStorageLevel" data-isabs="false"> + <a id="getStorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getStorageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Get the RDD's current storage level, or StorageLevel.</p><div class="fullcomment"><div class="comment cmt"><p>Get the RDD's current storage level, or StorageLevel.NONE if none is set.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#glom" data-isabs="false"> + <a id="glom():RDD[Array[(T, U)]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">glom</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[<span name="scala.Array" class="extype">Array</span>[(T, U)]]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by coalescing all elements within each partition into an array.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by coalescing all elements within each partition into an array. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((T, U)) ⇒ K,Partitioner)(ClassManifest[K]):RDD[(K, Seq[(T, U)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((T, U)) ⇒ K</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(T, U)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((T, U)) ⇒ K,Int)(ClassManifest[K]):RDD[(K, Seq[(T, U)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((T, U)) ⇒ K</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(T, U)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped elements.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped elements. Each group consists of a key and a sequence of elements +mapping to that key. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#groupBy" data-isabs="false"> + <a id="groupBy[K](((T, U)) ⇒ K)(ClassManifest[K]):RDD[(K, Seq[(T, U)])]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((T, U)) ⇒ K</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[K]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, Seq[(T, U)])]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD of grouped items.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD of grouped items. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <p class="shortcomment cmt">A unique ID for this RDD (within its SparkContext).</p><div class="fullcomment"><div class="comment cmt"><p>A unique ID for this RDD (within its SparkContext).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#isCheckpointed" data-isabs="false"> + <a id="isCheckpointed:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isCheckpointed</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return whether this RDD has been checkpointed or not +</p><div class="fullcomment"><div class="comment cmt"><p>Return whether this RDD has been checkpointed or not +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#iterator" data-isabs="false"> + <a id="iterator(Partition,TaskContext):Iterator[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>, <span name="context">context: <a name="spark.TaskContext" class="extype" href="../TaskContext.html">TaskContext</a></span>)</span><span class="result">: Iterator[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Internal method to this RDD; will read from cache if applicable, or otherwise compute it.</p><div class="fullcomment"><div class="comment cmt"><p>Internal method to this RDD; will read from cache if applicable, or otherwise compute it. +This should <i>not</i> be called by users directly, but is available for implementors of custom +subclasses of RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#keyBy" data-isabs="false"> + <a id="keyBy[K](((T, U)) ⇒ K):RDD[(K, (T, U))]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keyBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((T, U)) ⇒ K</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(K, (T, U))]</span> + </span> + </h4> + <p class="shortcomment cmt">Creates tuples of the elements in this RDD by applying <code>f</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Creates tuples of the elements in this RDD by applying <code>f</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#map" data-isabs="false"> + <a id="map[U](((T, U)) ⇒ U)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((T, U)) ⇒ U</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to all elements of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to all elements of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitions" data-isabs="false"> + <a id="mapPartitions[U]((Iterator[(T, U)]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitions</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (Iterator[(T, U)]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#mapPartitionsWithIndex" data-isabs="false"> + <a id="mapPartitionsWithIndex[U]((Int, Iterator[(T, U)]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapPartitionsWithIndex</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[(T, U)]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#name" data-isabs="false"> + <a id="name:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">name</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A friendly name for this RDD</p><div class="fullcomment"><div class="comment cmt"><p>A friendly name for this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitioner" data-isabs="false"> + <a id="partitioner:Option[Partitioner]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">partitioner</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[<a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Optionally overridden by subclasses to specify how they are partitioned.</p><div class="fullcomment"><div class="comment cmt"><p>Optionally overridden by subclasses to specify how they are partitioned.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#partitions" data-isabs="false"> + <a id="partitions:Array[Partition]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">partitions</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<a name="spark.Partition" class="extype" href="../Partition.html">Partition</a>]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the array of partitions of this RDD, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist():RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">()</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p><div class="fullcomment"><div class="comment cmt"><p>Persist this RDD with the default storage level (<code>MEMORY_ONLY</code>).</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#persist" data-isabs="false"> + <a id="persist(StorageLevel):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">persist</span><span class="params">(<span name="newLevel">newLevel: <a name="spark.storage.StorageLevel" class="extype" href="../storage/StorageLevel.html">StorageLevel</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Set this RDD's storage level to persist its values across operations after the first time +it is computed.</p><div class="fullcomment"><div class="comment cmt"><p>Set this RDD's storage level to persist its values across operations after the first time +it is computed. Can only be called once on each RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String],Map[String, String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>, <span name="env">env: <span name="scala.collection.Map" class="extype">Map</span>[String, String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(Seq[String]):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: Seq[String]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#pipe" data-isabs="false"> + <a id="pipe(String):RDD[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">pipe</span><span class="params">(<span name="command">command: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD created by piping elements to a forked external process.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD created by piping elements to a forked external process. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#preferredLocations" data-isabs="false"> + <a id="preferredLocations(Partition):Seq[String]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preferredLocations</span><span class="params">(<span name="split">split: <a name="spark.Partition" class="extype" href="../Partition.html">Partition</a></span>)</span><span class="result">: Seq[String]</span> + </span> + </h4> + <p class="shortcomment cmt">Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not.</p><div class="fullcomment"><div class="comment cmt"><p>Get the preferred location of a split, taking into account whether the +RDD is checkpointed or not. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.rdd.ZippedRDD#rdd1" data-isabs="false"> + <a id="rdd1:RDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">rdd1</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[T]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.rdd.ZippedRDD#rdd2" data-isabs="false"> + <a id="rdd2:RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">rdd2</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.RDD#reduce" data-isabs="false"> + <a id="reduce(((T, U), (T, U)) ⇒ (T, U)):(T, U)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="params">(<span name="f">f: ((T, U), (T, U)) ⇒ (T, U)</span>)</span><span class="result">: (T, U)</span> + </span> + </h4> + <p class="shortcomment cmt">Reduces the elements of this RDD using the specified commutative and associative binary operator.</p><div class="fullcomment"><div class="comment cmt"><p>Reduces the elements of this RDD using the specified commutative and associative binary operator. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#sample" data-isabs="false"> + <a id="sample(Boolean,Double,Int):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="fraction">fraction: <span name="scala.Double" class="extype">Double</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a sampled subset of this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return a sampled subset of this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsObjectFile" data-isabs="false"> + <a id="saveAsObjectFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsObjectFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a SequenceFile of serialized objects.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a SequenceFile of serialized objects. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#saveAsTextFile" data-isabs="false"> + <a id="saveAsTextFile(String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">saveAsTextFile</span><span class="params">(<span name="path">path: String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Save this RDD as a text file, using string representations of elements.</p><div class="fullcomment"><div class="comment cmt"><p>Save this RDD as a text file, using string representations of elements. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#setName" data-isabs="false"> + <a id="setName(String):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setName</span><span class="params">(<span name="_name">_name: String</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Assign a name to this RDD</p><div class="fullcomment"><div class="comment cmt"><p>Assign a name to this RDD</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[(T, U)],Partitioner):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span>, <span name="p">p: <a name="spark.Partitioner" class="extype" href="../Partitioner.html">Partitioner</a></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[(T, U)],Int):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#subtract" data-isabs="false"> + <a id="subtract(RDD[(T, U)]):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><div class="fullcomment"><div class="comment cmt"><p>Return an RDD with the elements from <code>this</code> that are not in <code>other</code>.</p><p>Uses <code>this</code> partitioner/partition size, because even if <code>other</code> is huge, the resulting +RDD will be <= us. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#take" data-isabs="false"> + <a id="take(Int):Array[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="num">num: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Take the first num elements of the RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Take the first num elements of the RDD. This currently scans the partitions *one by one*, so +it will be slow if a lot of partitions are required. In that case, use collect() to get the +whole RDD instead. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#takeSample" data-isabs="false"> + <a id="takeSample(Boolean,Int,Int):Array[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeSample</span><span class="params">(<span name="withReplacement">withReplacement: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="num">num: <span name="scala.Int" class="extype">Int</span></span>, <span name="seed">seed: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(T, U)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toArray" data-isabs="false"> + <a id="toArray():Array[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="params">()</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return an array that contains all of the elements in this RDD.</p><div class="fullcomment"><div class="comment cmt"><p>Return an array that contains all of the elements in this RDD. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toDebugString" data-isabs="false"> + <a id="toDebugString:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toDebugString</span><span class="result">: String</span> + </span> + </h4> + <p class="shortcomment cmt">A description of this RDD and its recursive dependencies for debugging.</p><div class="fullcomment"><div class="comment cmt"><p>A description of this RDD and its recursive dependencies for debugging.</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="spark.RDD#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.RDD#union" data-isabs="false"> + <a id="union(RDD[(T, U)]):RDD[(T, U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Return the union of this RDD and another one.</p><div class="fullcomment"><div class="comment cmt"><p>Return the union of this RDD and another one. Any identical elements will appear multiple +times (use <code>.distinct()</code> to eliminate them). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.RDD#zip" data-isabs="false"> + <a id="zip[U](RDD[U])(ClassManifest[U]):RDD[((T, U), U)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="other">other: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[((T, U), U)]</span> + </span> + </h4> + <p class="shortcomment cmt">Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc.</p><div class="fullcomment"><div class="comment cmt"><p>Zips this RDD with another one, returning key-value pairs with the first element in each RDD, +second element in each RDD, etc. Assumes that the two RDDs have the *same number of +partitions* and the *same number of elements in each partition* (e.g. one was made through +a map on the other). +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="spark.RDD#mapPartitionsWithSplit" data-isabs="false"> + <a id="mapPartitionsWithSplit[U]((Int, Iterator[(T, U)]) ⇒ Iterator[U],Boolean)(ClassManifest[U]):RDD[U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version scala.this.deprecated.init$default$2) use mapPartitionsWithIndex">mapPartitionsWithSplit</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (<span name="scala.Int" class="extype">Int</span>, Iterator[(T, U)]) ⇒ Iterator[U]</span>, <span name="preservesPartitioning">preservesPartitioning: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[U]</span>)</span><span class="result">: <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[U]</span> + </span> + </h4> + <p class="shortcomment cmt">Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition.</p><div class="fullcomment"><div class="comment cmt"><p>Return a new RDD by applying a function to each partition of this RDD, while tracking the index +of the original partition. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.RDD" class="extype" href="../RDD.html">RDD</a></dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version scala.this.deprecated.init$default$2)</i> use mapPartitionsWithIndex</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="spark.RDD" class="parent"> + <h3>Inherited from <a name="spark.RDD" class="extype" href="../RDD.html">RDD</a>[(T, U)]</h3> + </div><div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/rdd/package.html b/site/docs/0.7.0/api/core/spark/rdd/package.html new file mode 100644 index 000000000..584455797 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/rdd/package.html @@ -0,0 +1,247 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.rdd</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a></p> + <h1>rdd</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">rdd</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + <div class="types members" id="types"> + <h3>Type Members</h3> + <ol><li visbl="pub" name="spark.rdd.CoGroupedRDD" data-isabs="false"> + <a id="CoGroupedRDD:CoGroupedRDD[K]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="CoGroupedRDD.html"><span class="name">CoGroupedRDD</span></a><span class="tparams">[<span name="K">K</span>]</span><span class="result"> extends RDD[(K, Seq[Seq[_]])]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.rdd.CoalescedRDD" data-isabs="false"> + <a id="CoalescedRDD:CoalescedRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="CoalescedRDD.html"><span class="name">CoalescedRDD</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends RDD[T]</span> + </span> + </h4> + <p class="comment cmt">Coalesce the partitions of a parent RDD (<code>prev</code>) into fewer partitions, so that each partition of +this RDD computes one or more of the parent ones.</p> + </li><li visbl="pub" name="spark.rdd.HadoopRDD" data-isabs="false"> + <a id="HadoopRDD:HadoopRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="HadoopRDD.html"><span class="name">HadoopRDD</span></a><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends RDD[(K, V)] with Logging</span> + </span> + </h4> + <p class="comment cmt">An RDD that reads a Hadoop dataset as specified by a JobConf (e.</p> + </li><li visbl="pub" name="spark.rdd.NewHadoopRDD" data-isabs="false"> + <a id="NewHadoopRDD:NewHadoopRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="NewHadoopRDD.html"><span class="name">NewHadoopRDD</span></a><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends RDD[(K, V)] with HadoopMapReduceUtil with Logging</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.rdd.PartitionPruningRDD" data-isabs="false"> + <a id="PartitionPruningRDD:PartitionPruningRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="PartitionPruningRDD.html"><span class="name">PartitionPruningRDD</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends RDD[T]</span> + </span> + </h4> + <p class="comment cmt">A RDD used to prune RDD partitions/partitions so we can avoid launching tasks on +all partitions.</p> + </li><li visbl="pub" name="spark.rdd.PartitionPruningRDDPartition" data-isabs="false"> + <a id="PartitionPruningRDDPartition:PartitionPruningRDDPartition"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="PartitionPruningRDDPartition.html"><span class="name">PartitionPruningRDDPartition</span></a><span class="result"> extends Partition</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.rdd.PipedRDD" data-isabs="false"> + <a id="PipedRDD:PipedRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="PipedRDD.html"><span class="name">PipedRDD</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends RDD[String]</span> + </span> + </h4> + <p class="comment cmt">An RDD that pipes the contents of each parent partition through an external command +(printing them one per line) and returns the output as a collection of strings.</p> + </li><li visbl="pub" name="spark.rdd.PruneDependency" data-isabs="false"> + <a id="PruneDependency:PruneDependency[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="PruneDependency.html"><span class="name">PruneDependency</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends NarrowDependency[T]</span> + </span> + </h4> + <p class="comment cmt">Represents a dependency between the PartitionPruningRDD and its parent.</p> + </li><li visbl="pub" name="spark.rdd.SampledRDD" data-isabs="false"> + <a id="SampledRDD:SampledRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="SampledRDD.html"><span class="name">SampledRDD</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends RDD[T]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.rdd.ShuffledRDD" data-isabs="false"> + <a id="ShuffledRDD:ShuffledRDD[K, V]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="ShuffledRDD.html"><span class="name">ShuffledRDD</span></a><span class="tparams">[<span name="K">K</span>, <span name="V">V</span>]</span><span class="result"> extends RDD[(K, V)]</span> + </span> + </h4> + <p class="comment cmt">The resulting RDD from a shuffle (e.</p> + </li><li visbl="pub" name="spark.rdd.UnionRDD" data-isabs="false"> + <a id="UnionRDD:UnionRDD[T]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="UnionRDD.html"><span class="name">UnionRDD</span></a><span class="tparams">[<span name="T">T</span>]</span><span class="result"> extends RDD[T]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.rdd.ZippedRDD" data-isabs="false"> + <a id="ZippedRDD:ZippedRDD[T, U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="ZippedRDD.html"><span class="name">ZippedRDD</span></a><span class="tparams">[<span name="T">T</span>, <span name="U">U</span>]</span><span class="result"> extends RDD[(T, U)]</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.rdd.PartitionPruningRDD" data-isabs="false"> + <a id="PartitionPruningRDD:PartitionPruningRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="PartitionPruningRDD$.html"><span class="name">PartitionPruningRDD</span></a><span class="result"> extends Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.rdd.PipedRDD" data-isabs="false"> + <a id="PipedRDD:PipedRDD"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="PipedRDD$.html"><span class="name">PipedRDD</span></a><span class="result"> extends Serializable</span> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/serializer/DeserializationStream.html b/site/docs/0.7.0/api/core/spark/serializer/DeserializationStream.html new file mode 100644 index 000000000..fbdb2262c --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/serializer/DeserializationStream.html @@ -0,0 +1,397 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.serializer.DeserializationStream</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/trait_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.serializer" class="extype" href="package.html">serializer</a></p> + <h1>DeserializationStream</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <span class="name">DeserializationStream</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A stream for reading serialized objects. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent">AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.serializer.DeserializationStream" class="in"><span>DeserializationStream</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.serializer.DeserializationStream#close" data-isabs="true"> + <a id="close():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">close</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.serializer.DeserializationStream#readObject" data-isabs="true"> + <a id="readObject[T]():T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readObject</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">()</span><span class="result">: T</span> + </span> + </h4> + + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.serializer.DeserializationStream#asIterator" data-isabs="false"> + <a id="asIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <p class="shortcomment cmt">Read the elements of this stream through an iterator.</p><div class="fullcomment"><div class="comment cmt"><p>Read the elements of this stream through an iterator. This can only be called once, as +reading each element will consume data from the input source. +</p></div></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/serializer/SerializationStream.html b/site/docs/0.7.0/api/core/spark/serializer/SerializationStream.html new file mode 100644 index 000000000..337539cdd --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/serializer/SerializationStream.html @@ -0,0 +1,407 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.serializer.SerializationStream</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/trait_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.serializer" class="extype" href="package.html">serializer</a></p> + <h1>SerializationStream</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <span class="name">SerializationStream</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A stream for writing serialized objects. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent">AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.serializer.SerializationStream" class="in"><span>SerializationStream</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.serializer.SerializationStream#close" data-isabs="true"> + <a id="close():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">close</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.serializer.SerializationStream#flush" data-isabs="true"> + <a id="flush():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flush</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.serializer.SerializationStream#writeObject" data-isabs="true"> + <a id="writeObject[T](T):SerializationStream"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">writeObject</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="t">t: T</span>)</span><span class="result">: <a name="spark.serializer.SerializationStream" class="extype" href="">SerializationStream</a></span> + </span> + </h4> + + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.serializer.SerializationStream#writeAll" data-isabs="false"> + <a id="writeAll[T](Iterator[T]):SerializationStream"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">writeAll</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="iter">iter: Iterator[T]</span>)</span><span class="result">: <a name="spark.serializer.SerializationStream" class="extype" href="">SerializationStream</a></span> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/serializer/Serializer.html b/site/docs/0.7.0/api/core/spark/serializer/Serializer.html new file mode 100644 index 000000000..5c8949fac --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/serializer/Serializer.html @@ -0,0 +1,376 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.serializer.Serializer</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/trait_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.serializer" class="extype" href="package.html">serializer</a></p> + <h1>Serializer</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <span class="name">Serializer</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A serializer. Because some serialization libraries are not thread safe, this class is used to +create <a name="spark.serializer.SerializerInstance" class="extype" href="SerializerInstance.html">SerializerInstance</a> objects that do the actual serialization and are +guaranteed to only be called from one thread at a time. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent">AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div><div class="toggleContainer block"> + <span class="toggle">Known Subclasses</span> + <div class="subClasses hiddenContent"><a name="spark.JavaSerializer" class="extype" href="../JavaSerializer.html">JavaSerializer</a>, <a name="spark.KryoSerializer" class="extype" href="../KryoSerializer.html">KryoSerializer</a></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.serializer.Serializer" class="in"><span>Serializer</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.serializer.Serializer#newInstance" data-isabs="true"> + <a id="newInstance():SerializerInstance"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">newInstance</span><span class="params">()</span><span class="result">: <a name="spark.serializer.SerializerInstance" class="extype" href="SerializerInstance.html">SerializerInstance</a></span> + </span> + </h4> + + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/serializer/SerializerInstance.html b/site/docs/0.7.0/api/core/spark/serializer/SerializerInstance.html new file mode 100644 index 000000000..9abefb67f --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/serializer/SerializerInstance.html @@ -0,0 +1,443 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.serializer.SerializerInstance</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/trait_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.serializer" class="extype" href="package.html">serializer</a></p> + <h1>SerializerInstance</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <span class="name">SerializerInstance</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>An instance of a serializer, for use by one thread at a time. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent">AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.serializer.SerializerInstance" class="in"><span>SerializerInstance</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + <div class="values members" id="values"> + <h3>Abstract Value Members</h3> + <ol><li visbl="pub" name="spark.serializer.SerializerInstance#deserialize" data-isabs="true"> + <a id="deserialize[T](ByteBuffer,ClassLoader):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">deserialize</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="bytes">bytes: <span name="java.nio.ByteBuffer" class="extype">ByteBuffer</span></span>, <span name="loader">loader: <span name="java.lang.ClassLoader" class="extype">ClassLoader</span></span>)</span><span class="result">: T</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.serializer.SerializerInstance#deserialize" data-isabs="true"> + <a id="deserialize[T](ByteBuffer):T"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">deserialize</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="bytes">bytes: <span name="java.nio.ByteBuffer" class="extype">ByteBuffer</span></span>)</span><span class="result">: T</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.serializer.SerializerInstance#deserializeStream" data-isabs="true"> + <a id="deserializeStream(InputStream):DeserializationStream"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">deserializeStream</span><span class="params">(<span name="s">s: <span name="java.io.InputStream" class="extype">InputStream</span></span>)</span><span class="result">: <a name="spark.serializer.DeserializationStream" class="extype" href="DeserializationStream.html">DeserializationStream</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.serializer.SerializerInstance#serialize" data-isabs="true"> + <a id="serialize[T](T):ByteBuffer"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">serialize</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="t">t: T</span>)</span><span class="result">: <span name="java.nio.ByteBuffer" class="extype">ByteBuffer</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.serializer.SerializerInstance#serializeStream" data-isabs="true"> + <a id="serializeStream(OutputStream):SerializationStream"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">abstract </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">serializeStream</span><span class="params">(<span name="s">s: <span name="java.io.OutputStream" class="extype">OutputStream</span></span>)</span><span class="result">: <a name="spark.serializer.SerializationStream" class="extype" href="SerializationStream.html">SerializationStream</a></span> + </span> + </h4> + + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Concrete Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.serializer.SerializerInstance#deserializeMany" data-isabs="false"> + <a id="deserializeMany(ByteBuffer):Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">deserializeMany</span><span class="params">(<span name="buffer">buffer: <span name="java.nio.ByteBuffer" class="extype">ByteBuffer</span></span>)</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.serializer.SerializerInstance#serializeMany" data-isabs="false"> + <a id="serializeMany[T](Iterator[T]):ByteBuffer"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">serializeMany</span><span class="tparams">[<span name="T">T</span>]</span><span class="params">(<span name="iterator">iterator: Iterator[T]</span>)</span><span class="result">: <span name="java.nio.ByteBuffer" class="extype">ByteBuffer</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/serializer/package.html b/site/docs/0.7.0/api/core/spark/serializer/package.html new file mode 100644 index 000000000..d1a8bf000 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/serializer/package.html @@ -0,0 +1,121 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.serializer</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a></p> + <h1>serializer</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">serializer</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + <div class="types members" id="types"> + <h3>Type Members</h3> + <ol><li visbl="pub" name="spark.serializer.DeserializationStream" data-isabs="true"> + <a id="DeserializationStream:DeserializationStream"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <a href="DeserializationStream.html"><span class="name">DeserializationStream</span></a><span class="result"> extends AnyRef</span> + </span> + </h4> + <p class="comment cmt">A stream for reading serialized objects.</p> + </li><li visbl="pub" name="spark.serializer.SerializationStream" data-isabs="true"> + <a id="SerializationStream:SerializationStream"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <a href="SerializationStream.html"><span class="name">SerializationStream</span></a><span class="result"> extends AnyRef</span> + </span> + </h4> + <p class="comment cmt">A stream for writing serialized objects.</p> + </li><li visbl="pub" name="spark.serializer.Serializer" data-isabs="true"> + <a id="Serializer:Serializer"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <a href="Serializer.html"><span class="name">Serializer</span></a><span class="result"> extends AnyRef</span> + </span> + </h4> + <p class="comment cmt">A serializer.</p> + </li><li visbl="pub" name="spark.serializer.SerializerInstance" data-isabs="true"> + <a id="SerializerInstance:SerializerInstance"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">trait</span> + </span> + <span class="symbol"> + <a href="SerializerInstance.html"><span class="name">SerializerInstance</span></a><span class="result"> extends AnyRef</span> + </span> + </h4> + <p class="comment cmt">An instance of a serializer, for use by one thread at a time.</p> + </li></ol> + </div> + + + + + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/storage/BlockManagerSlaveActor.html b/site/docs/0.7.0/api/core/spark/storage/BlockManagerSlaveActor.html new file mode 100644 index 000000000..3cdf620d8 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/storage/BlockManagerSlaveActor.html @@ -0,0 +1,509 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.storage.BlockManagerSlaveActor</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.storage" class="extype" href="package.html">storage</a></p> + <h1>BlockManagerSlaveActor</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">BlockManagerSlaveActor</span><span class="result"> extends <span name="akka.actor.Actor" class="extype">Actor</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>An actor to take commands from the master to execute options. For example, +this is used to remove blocks from the slave's BlockManager. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="akka.actor.Actor" class="extype">Actor</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.storage.BlockManagerSlaveActor" class="in"><span>BlockManagerSlaveActor</span></li><li name="akka.actor.Actor" class="in"><span>Actor</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.storage.BlockManagerSlaveActor#this" data-isabs="false"> + <a id="this:BlockManagerSlaveActor"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">BlockManagerSlaveActor</span><span class="params">(<span name="blockManager">blockManager: <span name="spark.storage.BlockManager" class="extype">BlockManager</span></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + <div class="types members" id="types"> + <h3>Type Members</h3> + <ol><li visbl="pub" name="akka.actor.Actor#Receive" data-isabs="false"> + <a id="Receive:Receive"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">type</span> + </span> + <span class="symbol"> + <span class="name">Receive</span><span class="result"> = <span name="scala.PartialFunction" class="extype">PartialFunction</span>[<span name="scala.Any" class="extype">Any</span>, <span name="scala.Unit" class="extype">Unit</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Actor</dd></dl></div> + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="prt" name="akka.actor.Actor#context" data-isabs="false"> + <a id="context:ActorContext"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">context</span><span class="result">: <span name="akka.actor.ActorContext" class="extype">ActorContext</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="akka" class="extype" href="../../akka/package.html">akka</a>] </dd><dt>Definition Classes</dt><dd>Actor</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="akka.actor.Actor#postRestart" data-isabs="false"> + <a id="postRestart(Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">postRestart</span><span class="params">(<span name="reason">reason: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Actor</dd></dl></div> + </li><li visbl="pub" name="akka.actor.Actor#postStop" data-isabs="false"> + <a id="postStop():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">postStop</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Actor</dd></dl></div> + </li><li visbl="pub" name="akka.actor.Actor#preRestart" data-isabs="false"> + <a id="preRestart(Throwable,Option[Any]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preRestart</span><span class="params">(<span name="reason">reason: Throwable</span>, <span name="message">message: <span name="scala.Option" class="extype">Option</span>[<span name="scala.Any" class="extype">Any</span>]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Actor</dd></dl></div> + </li><li visbl="pub" name="akka.actor.Actor#preStart" data-isabs="false"> + <a id="preStart():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">preStart</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Actor</dd></dl></div> + </li><li visbl="pub" name="spark.storage.BlockManagerSlaveActor#receive" data-isabs="false"> + <a id="receive:PartialFunction[Any, Unit]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">receive</span><span class="result">: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[<span name="scala.Any" class="extype">Any</span>, <span name="scala.Unit" class="extype">Unit</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.BlockManagerSlaveActor" class="extype" href="">BlockManagerSlaveActor</a> → Actor</dd></dl></div> + </li><li visbl="pub" name="akka.actor.Actor#self" data-isabs="false"> + <a id="self:ActorRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit final </span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">self</span><span class="result">: <span name="akka.actor.ActorRef" class="extype">ActorRef</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Actor</dd></dl></div> + </li><li visbl="pub" name="akka.actor.Actor#sender" data-isabs="false"> + <a id="sender:ActorRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sender</span><span class="result">: <span name="akka.actor.ActorRef" class="extype">ActorRef</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Actor</dd></dl></div> + </li><li visbl="pub" name="akka.actor.Actor#supervisorStrategy" data-isabs="false"> + <a id="supervisorStrategy():SupervisorStrategy"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">supervisorStrategy</span><span class="params">()</span><span class="result">: <span name="akka.actor.SupervisorStrategy" class="extype">SupervisorStrategy</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Actor</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="akka.actor.Actor#unhandled" data-isabs="false"> + <a id="unhandled(Any):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">unhandled</span><span class="params">(<span name="message">message: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Actor</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="akka.actor.Actor" class="parent"> + <h3>Inherited from <span name="akka.actor.Actor" class="extype">Actor</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/storage/RDDInfo.html b/site/docs/0.7.0/api/core/spark/storage/RDDInfo.html new file mode 100644 index 000000000..5c79fb46e --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/storage/RDDInfo.html @@ -0,0 +1,540 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.storage.RDDInfo</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.storage" class="extype" href="package.html">storage</a></p> + <h1>RDDInfo</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">case class</span> + </span> + <span class="symbol"> + <span class="name">RDDInfo</span><span class="params">(<span name="id">id: <span name="scala.Int" class="extype">Int</span></span>, <span name="name">name: String</span>, <span name="storageLevel">storageLevel: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span>, <span name="numCachedPartitions">numCachedPartitions: <span name="scala.Int" class="extype">Int</span></span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>, <span name="memSize">memSize: <span name="scala.Long" class="extype">Long</span></span>, <span name="diskSize">diskSize: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result"> extends <span name="scala.Product" class="extype">Product</span> with <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.storage.RDDInfo" class="in"><span>RDDInfo</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.storage.RDDInfo#this" data-isabs="false"> + <a id="this:RDDInfo"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">RDDInfo</span><span class="params">(<span name="id">id: <span name="scala.Int" class="extype">Int</span></span>, <span name="name">name: String</span>, <span name="storageLevel">storageLevel: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span>, <span name="numCachedPartitions">numCachedPartitions: <span name="scala.Int" class="extype">Int</span></span>, <span name="numPartitions">numPartitions: <span name="scala.Int" class="extype">Int</span></span>, <span name="memSize">memSize: <span name="scala.Long" class="extype">Long</span></span>, <span name="diskSize">diskSize: <span name="scala.Long" class="extype">Long</span></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.storage.RDDInfo#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.RDDInfo" class="extype" href="">RDDInfo</a> → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.storage.RDDInfo#diskSize" data-isabs="false"> + <a id="diskSize:Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">diskSize</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.storage.RDDInfo#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.RDDInfo" class="extype" href="">RDDInfo</a> → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.storage.RDDInfo#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.RDDInfo" class="extype" href="">RDDInfo</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.storage.RDDInfo#id" data-isabs="false"> + <a id="id:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">id</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.storage.RDDInfo#memSize" data-isabs="false"> + <a id="memSize:Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">memSize</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.RDDInfo#name" data-isabs="false"> + <a id="name:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">name</span><span class="result">: String</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.storage.RDDInfo#numCachedPartitions" data-isabs="false"> + <a id="numCachedPartitions:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">numCachedPartitions</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.RDDInfo#numPartitions" data-isabs="false"> + <a id="numPartitions:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">numPartitions</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.RDDInfo#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.RDDInfo" class="extype" href="">RDDInfo</a> → Product</dd></dl></div> + </li><li visbl="pub" name="spark.storage.RDDInfo#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.RDDInfo" class="extype" href="">RDDInfo</a> → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="spark.storage.RDDInfo#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.RDDInfo" class="extype" href="">RDDInfo</a> → Product</dd></dl></div> + </li><li visbl="pub" name="spark.storage.RDDInfo#storageLevel" data-isabs="false"> + <a id="storageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">storageLevel</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.storage.RDDInfo#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.RDDInfo" class="extype" href="">RDDInfo</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/storage/StorageLevel$.html b/site/docs/0.7.0/api/core/spark/storage/StorageLevel$.html new file mode 100644 index 000000000..e7a58a7af --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/storage/StorageLevel$.html @@ -0,0 +1,539 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.storage.StorageLevel</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="StorageLevel.html"><img src="../../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.storage" class="extype" href="package.html">storage</a></p> + <h1><a title="Go to companion" href="StorageLevel.html">StorageLevel</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">StorageLevel</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.storage.StorageLevel" class="in"><span>StorageLevel</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.storage.StorageLevel#DISK_ONLY" data-isabs="false"> + <a id="DISK_ONLY:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">DISK_ONLY</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.StorageLevel#DISK_ONLY_2" data-isabs="false"> + <a id="DISK_ONLY_2:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">DISK_ONLY_2</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.StorageLevel#MEMORY_AND_DISK" data-isabs="false"> + <a id="MEMORY_AND_DISK:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">MEMORY_AND_DISK</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.StorageLevel#MEMORY_AND_DISK_2" data-isabs="false"> + <a id="MEMORY_AND_DISK_2:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">MEMORY_AND_DISK_2</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.StorageLevel#MEMORY_AND_DISK_SER" data-isabs="false"> + <a id="MEMORY_AND_DISK_SER:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">MEMORY_AND_DISK_SER</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.StorageLevel#MEMORY_AND_DISK_SER_2" data-isabs="false"> + <a id="MEMORY_AND_DISK_SER_2:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">MEMORY_AND_DISK_SER_2</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.StorageLevel#MEMORY_ONLY" data-isabs="false"> + <a id="MEMORY_ONLY:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">MEMORY_ONLY</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.StorageLevel#MEMORY_ONLY_2" data-isabs="false"> + <a id="MEMORY_ONLY_2:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">MEMORY_ONLY_2</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.StorageLevel#MEMORY_ONLY_SER" data-isabs="false"> + <a id="MEMORY_ONLY_SER:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">MEMORY_ONLY_SER</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.StorageLevel#MEMORY_ONLY_SER_2" data-isabs="false"> + <a id="MEMORY_ONLY_SER_2:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">MEMORY_ONLY_SER_2</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.StorageLevel#NONE" data-isabs="false"> + <a id="NONE:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">NONE</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.StorageLevel#apply" data-isabs="false"> + <a id="apply(ObjectInput):StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="in">in: <span name="java.io.ObjectInput" class="extype">ObjectInput</span></span>)</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Read StorageLevel object from ObjectInput stream</p> + </li><li visbl="pub" name="spark.storage.StorageLevel#apply" data-isabs="false"> + <a id="apply(Int,Int):StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="flags">flags: <span name="scala.Int" class="extype">Int</span></span>, <span name="replication">replication: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Create a new StorageLevel object from its integer representation</p> + </li><li visbl="pub" name="spark.storage.StorageLevel#apply" data-isabs="false"> + <a id="apply(Boolean,Boolean,Boolean,Int):StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="useDisk">useDisk: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="useMemory">useMemory: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="deserialized">deserialized: <span name="scala.Boolean" class="extype">Boolean</span></span>, <span name="replication">replication: <span name="scala.Int" class="extype">Int</span> = <span class="symbol">1</span></span>)</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="StorageLevel.html">StorageLevel</a></span> + </span> + </h4> + <p class="shortcomment cmt">Create a new StorageLevel object</p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="spark.storage.StorageLevel#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/storage/StorageLevel.html b/site/docs/0.7.0/api/core/spark/storage/StorageLevel.html new file mode 100644 index 000000000..e1af7da21 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/storage/StorageLevel.html @@ -0,0 +1,485 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.storage.StorageLevel</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="StorageLevel$.html"><img src="../../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.storage" class="extype" href="package.html">storage</a></p> + <h1><a title="Go to companion" href="StorageLevel$.html">StorageLevel</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">StorageLevel</span><span class="result"> extends <span name="java.io.Externalizable" class="extype">Externalizable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Flags for controlling the storage of an RDD. Each StorageLevel records whether to use memory, +whether to drop the RDD to disk if it falls out of memory, whether to keep the data in memory +in a serialized format, and whether to replicate the RDD partitions on multiple nodes. +The spark.storage.StorageLevel$ singleton object contains some static constants for +commonly useful storage levels. To create your own storage level object, use the factor method +of the singleton object (<code>StorageLevel(...)</code>). +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="java.io.Externalizable" class="extype">Externalizable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.storage.StorageLevel" class="in"><span>StorageLevel</span></li><li name="java.io.Externalizable" class="in"><span>Externalizable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.storage.StorageLevel#this" data-isabs="false"> + <a id="this:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">StorageLevel</span><span class="params">()</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.storage.StorageLevel#clone" data-isabs="false"> + <a id="clone():StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: <a name="spark.storage.StorageLevel" class="extype" href="">StorageLevel</a></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.StorageLevel" class="extype" href="">StorageLevel</a> → AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.storage.StorageLevel#description" data-isabs="false"> + <a id="description:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">description</span><span class="result">: String</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.StorageLevel#deserialized" data-isabs="false"> + <a id="deserialized:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">deserialized</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.storage.StorageLevel#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="other">other: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.StorageLevel" class="extype" href="">StorageLevel</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.storage.StorageLevel#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.StorageLevel" class="extype" href="">StorageLevel</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.storage.StorageLevel#isValid" data-isabs="false"> + <a id="isValid:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isValid</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.storage.StorageLevel#readExternal" data-isabs="false"> + <a id="readExternal(ObjectInput):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readExternal</span><span class="params">(<span name="in">in: <span name="java.io.ObjectInput" class="extype">ObjectInput</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.StorageLevel" class="extype" href="">StorageLevel</a> → Externalizable</dd></dl></div> + </li><li visbl="pub" name="spark.storage.StorageLevel#replication" data-isabs="false"> + <a id="replication:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">replication</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.storage.StorageLevel#toInt" data-isabs="false"> + <a id="toInt:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toInt</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.StorageLevel#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.StorageLevel" class="extype" href="">StorageLevel</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.storage.StorageLevel#useDisk" data-isabs="false"> + <a id="useDisk:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">useDisk</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.StorageLevel#useMemory" data-isabs="false"> + <a id="useMemory:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">useMemory</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.storage.StorageLevel#writeExternal" data-isabs="false"> + <a id="writeExternal(ObjectOutput):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">writeExternal</span><span class="params">(<span name="out">out: <span name="java.io.ObjectOutput" class="extype">ObjectOutput</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.StorageLevel" class="extype" href="">StorageLevel</a> → Externalizable</dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="java.io.Externalizable" class="parent"> + <h3>Inherited from <span name="java.io.Externalizable" class="extype">Externalizable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/storage/html/index$.html b/site/docs/0.7.0/api/core/spark/storage/html/index$.html new file mode 100644 index 000000000..2b5d41d3d --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/storage/html/index$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.storage.html.index</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.storage" class="extype" href="../package.html">storage</a>.<a name="spark.storage.html" class="extype" href="package.html">html</a></p> + <h1>index</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">index</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template5" class="extype">Template5</span>[<span name="scala.Long" class="extype">Long</span>, <span name="scala.Long" class="extype">Long</span>, <span name="scala.Long" class="extype">Long</span>, <span name="scala.Array" class="extype">Array</span>[<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>], <span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>], <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template5" class="extype">Template5</span>[<span name="scala.Long" class="extype">Long</span>, <span name="scala.Long" class="extype">Long</span>, <span name="scala.Long" class="extype">Long</span>, <span name="scala.Array" class="extype">Array</span>[<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>], <span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>], <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.storage.html.index" class="in"><span>index</span></li><li name="twirl.api.Template5" class="in"><span>Template5</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.storage.html.index#apply" data-isabs="false"> + <a id="apply(Long,Long,Long,Array[RDDInfo],Array[StorageStatus]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="maxMem">maxMem: <span name="scala.Long" class="extype">Long</span></span>, <span name="remainingMem">remainingMem: <span name="scala.Long" class="extype">Long</span></span>, <span name="diskSpaceUsed">diskSpaceUsed: <span name="scala.Long" class="extype">Long</span></span>, <span name="rdds">rdds: <span name="scala.Array" class="extype">Array</span>[<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>]</span>, <span name="storageStatusList">storageStatusList: <span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.storage.html.index#f" data-isabs="false"> + <a id="f:(Long, Long, Long, Array[RDDInfo], Array[StorageStatus]) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (<span name="scala.Long" class="extype">Long</span>, <span name="scala.Long" class="extype">Long</span>, <span name="scala.Long" class="extype">Long</span>, <span name="scala.Array" class="extype">Array</span>[<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>], <span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>]) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.storage.html.index#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.storage.html.index#ref" data-isabs="false"> + <a id="ref:spark.storage.html.index.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.storage.html.index.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.html.index#render" data-isabs="false"> + <a id="render(Long,Long,Long,Array[RDDInfo],Array[StorageStatus]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="maxMem">maxMem: <span name="scala.Long" class="extype">Long</span></span>, <span name="remainingMem">remainingMem: <span name="scala.Long" class="extype">Long</span></span>, <span name="diskSpaceUsed">diskSpaceUsed: <span name="scala.Long" class="extype">Long</span></span>, <span name="rdds">rdds: <span name="scala.Array" class="extype">Array</span>[<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>]</span>, <span name="storageStatusList">storageStatusList: <span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.html.index" class="extype" href="">index</a> → Template5</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template5" class="parent"> + <h3>Inherited from <span name="twirl.api.Template5" class="extype">Template5</span>[<span name="scala.Long" class="extype">Long</span>, <span name="scala.Long" class="extype">Long</span>, <span name="scala.Long" class="extype">Long</span>, <span name="scala.Array" class="extype">Array</span>[<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>], <span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>], <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/storage/html/package.html b/site/docs/0.7.0/api/core/spark/storage/html/package.html new file mode 100644 index 000000000..ea42b5de2 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/storage/html/package.html @@ -0,0 +1,121 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.storage.html</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.storage" class="extype" href="../package.html">storage</a></p> + <h1>html</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">html</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.storage.html.index" data-isabs="false"> + <a id="index:index"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="index$.html"><span class="name">index</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template5[Long, Long, Long, Array[RDDInfo], Array[StorageStatus], Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li><li visbl="pub" name="spark.storage.html.rdd" data-isabs="false"> + <a id="rdd:rdd"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="rdd$.html"><span class="name">rdd</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template2[RDDInfo, Array[StorageStatus], Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li><li visbl="pub" name="spark.storage.html.rdd_table" data-isabs="false"> + <a id="rdd_table:rdd_table"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="rdd_table$.html"><span class="name">rdd_table</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template1[Array[RDDInfo], Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li><li visbl="pub" name="spark.storage.html.worker_table" data-isabs="false"> + <a id="worker_table:worker_table"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="worker_table$.html"><span class="name">worker_table</span></a><span class="result"> extends BaseScalaTemplate[Html, Format[Html]] with Template2[Array[StorageStatus], String, Html]</span> + </span> + </h4> + <p class="comment cmt"></p> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/storage/html/rdd$.html b/site/docs/0.7.0/api/core/spark/storage/html/rdd$.html new file mode 100644 index 000000000..34e250511 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/storage/html/rdd$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.storage.html.rdd</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.storage" class="extype" href="../package.html">storage</a>.<a name="spark.storage.html" class="extype" href="package.html">html</a></p> + <h1>rdd</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">rdd</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template2" class="extype">Template2</span>[<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>, <span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>], <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template2" class="extype">Template2</span>[<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>, <span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>], <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.storage.html.rdd" class="in"><span>rdd</span></li><li name="twirl.api.Template2" class="in"><span>Template2</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.storage.html.rdd#apply" data-isabs="false"> + <a id="apply(RDDInfo,Array[StorageStatus]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="rddInfo">rddInfo: <a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a></span>, <span name="storageStatusList">storageStatusList: <span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.storage.html.rdd#f" data-isabs="false"> + <a id="f:(RDDInfo, Array[StorageStatus]) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>, <span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>]) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.storage.html.rdd#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.storage.html.rdd#ref" data-isabs="false"> + <a id="ref:spark.storage.html.rdd.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.storage.html.rdd.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.html.rdd#render" data-isabs="false"> + <a id="render(RDDInfo,Array[StorageStatus]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="rddInfo">rddInfo: <a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a></span>, <span name="storageStatusList">storageStatusList: <span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.html.rdd" class="extype" href="">rdd</a> → Template2</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template2" class="parent"> + <h3>Inherited from <span name="twirl.api.Template2" class="extype">Template2</span>[<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>, <span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>], <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/storage/html/rdd_table$.html b/site/docs/0.7.0/api/core/spark/storage/html/rdd_table$.html new file mode 100644 index 000000000..6f4d93b07 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/storage/html/rdd_table$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.storage.html.rdd_table</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.storage" class="extype" href="../package.html">storage</a>.<a name="spark.storage.html" class="extype" href="package.html">html</a></p> + <h1>rdd_table</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">rdd_table</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="scala.Array" class="extype">Array</span>[<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>], <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template1" class="extype">Template1</span>[<span name="scala.Array" class="extype">Array</span>[<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>], <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.storage.html.rdd_table" class="in"><span>rdd_table</span></li><li name="twirl.api.Template1" class="in"><span>Template1</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.storage.html.rdd_table#apply" data-isabs="false"> + <a id="apply(Array[RDDInfo]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="rdds">rdds: <span name="scala.Array" class="extype">Array</span>[<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.storage.html.rdd_table#f" data-isabs="false"> + <a id="f:(Array[RDDInfo]) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (<span name="scala.Array" class="extype">Array</span>[<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>]) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.storage.html.rdd_table#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.storage.html.rdd_table#ref" data-isabs="false"> + <a id="ref:spark.storage.html.rdd_table.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.storage.html.rdd_table.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.html.rdd_table#render" data-isabs="false"> + <a id="render(Array[RDDInfo]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="rdds">rdds: <span name="scala.Array" class="extype">Array</span>[<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.html.rdd_table" class="extype" href="">rdd_table</a> → Template1</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template1" class="parent"> + <h3>Inherited from <span name="twirl.api.Template1" class="extype">Template1</span>[<span name="scala.Array" class="extype">Array</span>[<a name="spark.storage.RDDInfo" class="extype" href="../RDDInfo.html">RDDInfo</a>], <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/storage/html/worker_table$.html b/site/docs/0.7.0/api/core/spark/storage/html/worker_table$.html new file mode 100644 index 000000000..1080a4d15 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/storage/html/worker_table$.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.storage.html.worker_table</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../../lib/template.css" /> + <script type="text/javascript" src="../../../lib/jquery.js"></script> + <script type="text/javascript" src="../../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../../lib/template.js"></script> + <script type="text/javascript" src="../../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../../package.html">spark</a>.<a name="spark.storage" class="extype" href="../package.html">storage</a>.<a name="spark.storage.html" class="extype" href="package.html">html</a></p> + <h1>worker_table</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">worker_table</span><span class="result"> extends <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]] with <span name="twirl.api.Template2" class="extype">Template2</span>[<span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>], String, <span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="twirl.api.Template2" class="extype">Template2</span>[<span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>], String, <span name="twirl.api.Html" class="extype">Html</span>], <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]], <span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, <span name="scala.Product" class="extype">Product</span>, <span name="scala.Equals" class="extype">Equals</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.storage.html.worker_table" class="in"><span>worker_table</span></li><li name="twirl.api.Template2" class="in"><span>Template2</span></li><li name="twirl.api.BaseScalaTemplate" class="in"><span>BaseScalaTemplate</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.Product" class="in"><span>Product</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#_display_" data-isabs="false"> + <a id="_display_(Any)(Manifest[Html]):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">_display_</span><span class="params">(<span name="o">o: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="params">(<span class="implicit">implicit </span><span name="m">m: Manifest[<span name="twirl.api.Html" class="extype">Html</span>]</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.storage.html.worker_table#apply" data-isabs="false"> + <a id="apply(Array[StorageStatus],String):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="workersStatusList">workersStatusList: <span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>]</span>, <span name="prefix">prefix: String = <span class="symbol">""</span></span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <p class="shortcomment cmt"></p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.storage.html.worker_table#f" data-isabs="false"> + <a id="f:(Array[StorageStatus], String) ⇒ Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">f</span><span class="result">: (<span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>], String) ⇒ <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#format" data-isabs="false"> + <a id="format:Format[Html]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">format</span><span class="result">: <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productArity" data-isabs="false"> + <a id="productArity:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productArity</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productElement" data-isabs="false"> + <a id="productElement(Int):Any"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productElement</span><span class="params">(<span name="arg0">arg0: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Any" class="extype">Any</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="pub" name="scala.Product#productIterator" data-isabs="false"> + <a id="productIterator:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productIterator</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#productPrefix" data-isabs="false"> + <a id="productPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">productPrefix</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → Product</dd></dl></div> + </li><li visbl="prt" name="spark.storage.html.worker_table#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="spark.storage.html.worker_table#ref" data-isabs="false"> + <a id="ref:spark.storage.html.worker_table.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ref</span><span class="result">: spark.storage.html.worker_table.type</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.html.worker_table#render" data-isabs="false"> + <a id="render(Array[StorageStatus],String):Html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">render</span><span class="params">(<span name="workersStatusList">workersStatusList: <span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>]</span>, <span name="prefix">prefix: String</span>)</span><span class="result">: <span name="twirl.api.Html" class="extype">Html</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.storage.html.worker_table" class="extype" href="">worker_table</a> → Template2</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="twirl.api.BaseScalaTemplate#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>BaseScalaTemplate → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.Product#productElements" data-isabs="false"> + <a id="productElements:Iterator[Any]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use productIterator instead">productElements</span><span class="result">: Iterator[<span name="scala.Any" class="extype">Any</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Product</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use productIterator instead</p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="twirl.api.Template2" class="parent"> + <h3>Inherited from <span name="twirl.api.Template2" class="extype">Template2</span>[<span name="scala.Array" class="extype">Array</span>[<span name="spark.storage.StorageStatus" class="extype">StorageStatus</span>], String, <span name="twirl.api.Html" class="extype">Html</span>]</h3> + </div><div name="twirl.api.BaseScalaTemplate" class="parent"> + <h3>Inherited from <span name="twirl.api.BaseScalaTemplate" class="extype">BaseScalaTemplate</span>[<span name="twirl.api.Html" class="extype">Html</span>, <span name="twirl.api.Format" class="extype">Format</span>[<span name="twirl.api.Html" class="extype">Html</span>]]</h3> + </div><div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.Product" class="parent"> + <h3>Inherited from <span name="scala.Product" class="extype">Product</span></h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/storage/package.html b/site/docs/0.7.0/api/core/spark/storage/package.html new file mode 100644 index 000000000..b2b5378d4 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/storage/package.html @@ -0,0 +1,136 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.storage</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a></p> + <h1>storage</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">storage</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + <div class="types members" id="types"> + <h3>Type Members</h3> + <ol><li visbl="pub" name="spark.storage.BlockManagerSlaveActor" data-isabs="false"> + <a id="BlockManagerSlaveActor:BlockManagerSlaveActor"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="BlockManagerSlaveActor.html"><span class="name">BlockManagerSlaveActor</span></a><span class="result"> extends Actor</span> + </span> + </h4> + <p class="comment cmt">An actor to take commands from the master to execute options.</p> + </li><li visbl="pub" name="spark.storage.RDDInfo" data-isabs="false"> + <a id="RDDInfo:RDDInfo"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">case class</span> + </span> + <span class="symbol"> + <a href="RDDInfo.html"><span class="name">RDDInfo</span></a><span class="params">(<span name="id">id: Int</span>, <span name="name">name: String</span>, <span name="storageLevel">storageLevel: StorageLevel</span>, <span name="numCachedPartitions">numCachedPartitions: Int</span>, <span name="numPartitions">numPartitions: Int</span>, <span name="memSize">memSize: Long</span>, <span name="diskSize">diskSize: Long</span>)</span><span class="result"> extends Product with Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.StorageLevel" data-isabs="false"> + <a id="StorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="StorageLevel.html"><span class="name">StorageLevel</span></a><span class="result"> extends Externalizable</span> + </span> + </h4> + <p class="comment cmt">Flags for controlling the storage of an RDD.</p> + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.storage.StorageLevel" data-isabs="false"> + <a id="StorageLevel:StorageLevel"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="StorageLevel$.html"><span class="name">StorageLevel</span></a><span class="result"> extends Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.storage.html" data-isabs="false"> + <a id="html:html"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <a href="html/package.html"><span class="name">html</span></a> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/util/MetadataCleaner$.html b/site/docs/0.7.0/api/core/spark/util/MetadataCleaner$.html new file mode 100644 index 000000000..18525d0a1 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/util/MetadataCleaner$.html @@ -0,0 +1,379 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.util.MetadataCleaner</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="MetadataCleaner.html"><img src="../../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.util" class="extype" href="package.html">util</a></p> + <h1><a title="Go to companion" href="MetadataCleaner.html">MetadataCleaner</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">MetadataCleaner</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent">AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.util.MetadataCleaner" class="in"><span>MetadataCleaner</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.util.MetadataCleaner#getDelaySeconds" data-isabs="false"> + <a id="getDelaySeconds:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getDelaySeconds</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.util.MetadataCleaner#setDelaySeconds" data-isabs="false"> + <a id="setDelaySeconds(Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">setDelaySeconds</span><span class="params">(<span name="delay">delay: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/util/MetadataCleaner.html b/site/docs/0.7.0/api/core/spark/util/MetadataCleaner.html new file mode 100644 index 000000000..f428ff344 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/util/MetadataCleaner.html @@ -0,0 +1,529 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.util.MetadataCleaner</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="MetadataCleaner$.html"><img src="../../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.util" class="extype" href="package.html">util</a></p> + <h1><a title="Go to companion" href="MetadataCleaner$.html">MetadataCleaner</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">MetadataCleaner</span><span class="result"> extends <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>Runs a timer task to periodically clean up metadata (e.g. old files or hashtable entries) +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.util.MetadataCleaner" class="in"><span>MetadataCleaner</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.util.MetadataCleaner#this" data-isabs="false"> + <a id="this:MetadataCleaner"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">MetadataCleaner</span><span class="params">(<span name="name">name: String</span>, <span name="cleanupFunc">cleanupFunc: (<span name="scala.Long" class="extype">Long</span>) ⇒ <span name="scala.Unit" class="extype">Unit</span></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.util.MetadataCleaner#cancel" data-isabs="false"> + <a id="cancel():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">cancel</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/util/RateLimitedOutputStream.html b/site/docs/0.7.0/api/core/spark/util/RateLimitedOutputStream.html new file mode 100644 index 000000000..eee302931 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/util/RateLimitedOutputStream.html @@ -0,0 +1,487 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.util.RateLimitedOutputStream</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.util" class="extype" href="package.html">util</a></p> + <h1>RateLimitedOutputStream</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">RateLimitedOutputStream</span><span class="result"> extends <span name="java.io.OutputStream" class="extype">OutputStream</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="java.io.OutputStream" class="extype">OutputStream</span>, <span name="java.io.Flushable" class="extype">Flushable</span>, <span name="java.io.Closeable" class="extype">Closeable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.util.RateLimitedOutputStream" class="in"><span>RateLimitedOutputStream</span></li><li name="java.io.OutputStream" class="in"><span>OutputStream</span></li><li name="java.io.Flushable" class="in"><span>Flushable</span></li><li name="java.io.Closeable" class="in"><span>Closeable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.util.RateLimitedOutputStream#this" data-isabs="false"> + <a id="this:RateLimitedOutputStream"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">RateLimitedOutputStream</span><span class="params">(<span name="out">out: <span name="java.io.OutputStream" class="extype">OutputStream</span></span>, <span name="bytesPerSec">bytesPerSec: <span name="scala.Int" class="extype">Int</span></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.util.RateLimitedOutputStream#CHUNK_SIZE" data-isabs="false"> + <a id="CHUNK_SIZE:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">CHUNK_SIZE</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.RateLimitedOutputStream#SYNC_INTERVAL" data-isabs="false"> + <a id="SYNC_INTERVAL:Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">SYNC_INTERVAL</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.util.RateLimitedOutputStream#bytesWrittenSinceSync" data-isabs="false"> + <a id="bytesWrittenSinceSync:Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">bytesWrittenSinceSync</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.util.RateLimitedOutputStream#close" data-isabs="false"> + <a id="close():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">close</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.RateLimitedOutputStream" class="extype" href="">RateLimitedOutputStream</a> → OutputStream → Closeable</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.util.RateLimitedOutputStream#flush" data-isabs="false"> + <a id="flush():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flush</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.RateLimitedOutputStream" class="extype" href="">RateLimitedOutputStream</a> → OutputStream → Flushable</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.util.RateLimitedOutputStream#lastSyncTime" data-isabs="false"> + <a id="lastSyncTime:Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">var</span> + </span> + <span class="symbol"> + <span class="name">lastSyncTime</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.util.RateLimitedOutputStream#write" data-isabs="false"> + <a id="write(Array[Byte],Int,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">write</span><span class="params">(<span name="bytes">bytes: <span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]</span>, <span name="offset">offset: <span name="scala.Int" class="extype">Int</span></span>, <span name="length">length: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.RateLimitedOutputStream" class="extype" href="">RateLimitedOutputStream</a> → OutputStream</dd><dt>Annotations</dt><dd> + <span class="name">@tailrec</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.util.RateLimitedOutputStream#write" data-isabs="false"> + <a id="write(Array[Byte]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">write</span><span class="params">(<span name="bytes">bytes: <span name="scala.Array" class="extype">Array</span>[<span name="scala.Byte" class="extype">Byte</span>]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.RateLimitedOutputStream" class="extype" href="">RateLimitedOutputStream</a> → OutputStream</dd></dl></div> + </li><li visbl="pub" name="spark.util.RateLimitedOutputStream#write" data-isabs="false"> + <a id="write(Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">write</span><span class="params">(<span name="b">b: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.RateLimitedOutputStream" class="extype" href="">RateLimitedOutputStream</a> → OutputStream</dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="java.io.OutputStream" class="parent"> + <h3>Inherited from <span name="java.io.OutputStream" class="extype">OutputStream</span></h3> + </div><div name="java.io.Flushable" class="parent"> + <h3>Inherited from <span name="java.io.Flushable" class="extype">Flushable</span></h3> + </div><div name="java.io.Closeable" class="parent"> + <h3>Inherited from <span name="java.io.Closeable" class="extype">Closeable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/util/StatCounter$.html b/site/docs/0.7.0/api/core/spark/util/StatCounter$.html new file mode 100644 index 000000000..002aa3c2e --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/util/StatCounter$.html @@ -0,0 +1,395 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.util.StatCounter</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="StatCounter.html"><img src="../../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.util" class="extype" href="package.html">util</a></p> + <h1><a title="Go to companion" href="StatCounter.html">StatCounter</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">StatCounter</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.util.StatCounter" class="in"><span>StatCounter</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.util.StatCounter#apply" data-isabs="false"> + <a id="apply(Double*):StatCounter"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="values">values: <span name="scala.Double" class="extype">Double</span>*</span>)</span><span class="result">: <a name="spark.util.StatCounter" class="extype" href="StatCounter.html">StatCounter</a></span> + </span> + </h4> + <p class="shortcomment cmt">Build a StatCounter from a list of values passed as variable-length arguments.</p> + </li><li visbl="pub" name="spark.util.StatCounter#apply" data-isabs="false"> + <a id="apply(TraversableOnce[Double]):StatCounter"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="values">values: TraversableOnce[<span name="scala.Double" class="extype">Double</span>]</span>)</span><span class="result">: <a name="spark.util.StatCounter" class="extype" href="StatCounter.html">StatCounter</a></span> + </span> + </h4> + <p class="shortcomment cmt">Build a StatCounter from a list of values.</p> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="spark.util.StatCounter#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/util/StatCounter.html b/site/docs/0.7.0/api/core/spark/util/StatCounter.html new file mode 100644 index 000000000..0b37693cd --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/util/StatCounter.html @@ -0,0 +1,523 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.util.StatCounter</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="StatCounter$.html"><img src="../../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.util" class="extype" href="package.html">util</a></p> + <h1><a title="Go to companion" href="StatCounter$.html">StatCounter</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">StatCounter</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>A class for tracking the statistics of a set of numbers (count, mean and variance) in a +numerically robust way. Includes support for merging two StatCounters. Based on +<a href="http://en.wikipedia.org/wiki/Algorithms_for_calculating_variance">Welford and Chan's algorithms for running variance</a>. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.util.StatCounter" class="in"><span>StatCounter</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.util.StatCounter#this" data-isabs="false"> + <a id="this:StatCounter"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">StatCounter</span><span class="params">()</span> + </span> + </h4> + <p class="shortcomment cmt">Initialize the StatCounter with no values.</p> + </li><li visbl="pub" name="spark.util.StatCounter#this" data-isabs="false"> + <a id="this:StatCounter"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">StatCounter</span><span class="params">(<span name="values">values: TraversableOnce[<span name="scala.Double" class="extype">Double</span>]</span>)</span> + </span> + </h4> + <p class="shortcomment cmt">Initialize the StatCounter with the given values.</p> + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.util.StatCounter#copy" data-isabs="false"> + <a id="copy():StatCounter"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">copy</span><span class="params">()</span><span class="result">: <a name="spark.util.StatCounter" class="extype" href="">StatCounter</a></span> + </span> + </h4> + <p class="shortcomment cmt">Clone this StatCounter</p> + </li><li visbl="pub" name="spark.util.StatCounter#count" data-isabs="false"> + <a id="count:Long"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="result">: <span name="scala.Long" class="extype">Long</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.util.StatCounter#mean" data-isabs="false"> + <a id="mean:Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mean</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.StatCounter#merge" data-isabs="false"> + <a id="merge(StatCounter):StatCounter"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">merge</span><span class="params">(<span name="other">other: <a name="spark.util.StatCounter" class="extype" href="">StatCounter</a></span>)</span><span class="result">: <a name="spark.util.StatCounter" class="extype" href="">StatCounter</a></span> + </span> + </h4> + <p class="shortcomment cmt">Merge another StatCounter into this one, adding up the internal statistics.</p> + </li><li visbl="pub" name="spark.util.StatCounter#merge" data-isabs="false"> + <a id="merge(TraversableOnce[Double]):StatCounter"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">merge</span><span class="params">(<span name="values">values: TraversableOnce[<span name="scala.Double" class="extype">Double</span>]</span>)</span><span class="result">: <a name="spark.util.StatCounter" class="extype" href="">StatCounter</a></span> + </span> + </h4> + <p class="shortcomment cmt">Add multiple values into this StatCounter, updating the internal statistics.</p> + </li><li visbl="pub" name="spark.util.StatCounter#merge" data-isabs="false"> + <a id="merge(Double):StatCounter"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">merge</span><span class="params">(<span name="value">value: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.util.StatCounter" class="extype" href="">StatCounter</a></span> + </span> + </h4> + <p class="shortcomment cmt">Add a value into this StatCounter, updating the internal statistics.</p> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.util.StatCounter#sampleStdev" data-isabs="false"> + <a id="sampleStdev:Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sampleStdev</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the sample standard deviation of the values, which corrects for bias in estimating the +variance by dividing by N-1 instead of N.</p> + </li><li visbl="pub" name="spark.util.StatCounter#sampleVariance" data-isabs="false"> + <a id="sampleVariance:Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sampleVariance</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the sample variance, which corrects for bias in estimating the variance by dividing +by N-1 instead of N.</p> + </li><li visbl="pub" name="spark.util.StatCounter#stdev" data-isabs="false"> + <a id="stdev:Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">stdev</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the standard deviation of the values.</p> + </li><li visbl="pub" name="spark.util.StatCounter#sum" data-isabs="false"> + <a id="sum:Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sum</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.util.StatCounter#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.StatCounter" class="extype" href="">StatCounter</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.util.StatCounter#variance" data-isabs="false"> + <a id="variance:Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">variance</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">Return the variance of the values.</p> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/util/TimeStampedHashMap.html b/site/docs/0.7.0/api/core/spark/util/TimeStampedHashMap.html new file mode 100644 index 000000000..f37619521 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/util/TimeStampedHashMap.html @@ -0,0 +1,2560 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.util.TimeStampedHashMap</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.util" class="extype" href="package.html">util</a></p> + <h1>TimeStampedHashMap</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">TimeStampedHashMap</span><span class="tparams">[<span name="A">A</span>, <span name="B">B</span>]</span><span class="result"> extends <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B] with <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="comment cmt"><p>This is a custom implementation of scala.collection.mutable.Map which stores the insertion +time stamp along with each key-value pair. Key-value pairs that are older than a particular +threshold time can them be removed using the clearOldValues method. This is intended to be a drop-in +replacement of scala.collection.mutable.HashMap. +</p></div><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a>, <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], <span name="scala.collection.mutable.MapLike" class="extype">MapLike</span>[A, B, <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]], <span name="scala.collection.mutable.Cloneable" class="extype">Cloneable</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]], <span name="scala.collection.generic.Shrinkable" class="extype">Shrinkable</span>[A], <span name="scala.collection.mutable.Builder" class="extype">Builder</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]], <span name="scala.collection.generic.Growable" class="extype">Growable</span>[(A, B)], <span name="scala.collection.Map" class="extype">Map</span>[A, B], <span name="scala.collection.MapLike" class="extype">MapLike</span>[A, B, <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]], <span name="scala.collection.generic.Subtractable" class="extype">Subtractable</span>[A, <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]], <span name="scala.PartialFunction" class="extype">PartialFunction</span>[A, B], (A) ⇒ B, <span name="scala.collection.GenMap" class="extype">GenMap</span>[A, B], <span name="scala.collection.GenMapLike" class="extype">GenMapLike</span>[A, B, <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]], <span name="scala.collection.mutable.Iterable" class="extype">Iterable</span>[(A, B)], <span name="scala.collection.Iterable" class="extype">Iterable</span>[(A, B)], <span name="scala.collection.IterableLike" class="extype">IterableLike</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]], <span name="scala.Equals" class="extype">Equals</span>, <span name="scala.collection.GenIterable" class="extype">GenIterable</span>[(A, B)], <span name="scala.collection.GenIterableLike" class="extype">GenIterableLike</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]], <span name="scala.collection.mutable.Traversable" class="extype">Traversable</span>[(A, B)], <span name="scala.Mutable" class="extype">Mutable</span>, <span name="scala.collection.Traversable" class="extype">Traversable</span>[(A, B)], <span name="scala.collection.GenTraversable" class="extype">GenTraversable</span>[(A, B)], <span name="scala.collection.generic.GenericTraversableTemplate" class="extype">GenericTraversableTemplate</span>[(A, B), <span name="scala.collection.mutable.Iterable" class="extype">Iterable</span>], <span name="scala.collection.TraversableLike" class="extype">TraversableLike</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]], <span name="scala.collection.GenTraversableLike" class="extype">GenTraversableLike</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]], <span name="scala.collection.Parallelizable" class="extype">Parallelizable</span>[(A, B), <span name="scala.collection.parallel.mutable.ParMap" class="extype">ParMap</span>[A, B]], <span name="scala.collection.TraversableOnce" class="extype">TraversableOnce</span>[(A, B)], <span name="scala.collection.GenTraversableOnce" class="extype">GenTraversableOnce</span>[(A, B)], <span name="scala.collection.generic.FilterMonadic" class="extype">FilterMonadic</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]], <span name="scala.collection.generic.HasNewBuilder" class="extype">HasNewBuilder</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]], AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.util.TimeStampedHashMap" class="in"><span>TimeStampedHashMap</span></li><li name="spark.Logging" class="in"><span>Logging</span></li><li name="scala.collection.mutable.Map" class="in"><span>Map</span></li><li name="scala.collection.mutable.MapLike" class="in"><span>MapLike</span></li><li name="scala.collection.mutable.Cloneable" class="in"><span>Cloneable</span></li><li name="scala.collection.generic.Shrinkable" class="in"><span>Shrinkable</span></li><li name="scala.collection.mutable.Builder" class="in"><span>Builder</span></li><li name="scala.collection.generic.Growable" class="in"><span>Growable</span></li><li name="scala.collection.Map" class="in"><span>Map</span></li><li name="scala.collection.MapLike" class="in"><span>MapLike</span></li><li name="scala.collection.generic.Subtractable" class="in"><span>Subtractable</span></li><li name="scala.PartialFunction" class="in"><span>PartialFunction</span></li><li name="scala.Function1" class="in"><span>Function1</span></li><li name="scala.collection.GenMap" class="in"><span>GenMap</span></li><li name="scala.collection.GenMapLike" class="in"><span>GenMapLike</span></li><li name="scala.collection.mutable.Iterable" class="in"><span>Iterable</span></li><li name="scala.collection.Iterable" class="in"><span>Iterable</span></li><li name="scala.collection.IterableLike" class="in"><span>IterableLike</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.collection.GenIterable" class="in"><span>GenIterable</span></li><li name="scala.collection.GenIterableLike" class="in"><span>GenIterableLike</span></li><li name="scala.collection.mutable.Traversable" class="in"><span>Traversable</span></li><li name="scala.Mutable" class="in"><span>Mutable</span></li><li name="scala.collection.Traversable" class="in"><span>Traversable</span></li><li name="scala.collection.GenTraversable" class="in"><span>GenTraversable</span></li><li name="scala.collection.generic.GenericTraversableTemplate" class="in"><span>GenericTraversableTemplate</span></li><li name="scala.collection.TraversableLike" class="in"><span>TraversableLike</span></li><li name="scala.collection.GenTraversableLike" class="in"><span>GenTraversableLike</span></li><li name="scala.collection.Parallelizable" class="in"><span>Parallelizable</span></li><li name="scala.collection.TraversableOnce" class="in"><span>TraversableOnce</span></li><li name="scala.collection.GenTraversableOnce" class="in"><span>GenTraversableOnce</span></li><li name="scala.collection.generic.FilterMonadic" class="in"><span>FilterMonadic</span></li><li name="scala.collection.generic.HasNewBuilder" class="in"><span>HasNewBuilder</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.util.TimeStampedHashMap#this" data-isabs="false"> + <a id="this:TimeStampedHashMap[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">TimeStampedHashMap</span><span class="params">()</span> + </span> + </h4> + + </li></ol> + </div> + + <div class="types members" id="types"> + <h3>Type Members</h3> + <ol><li visbl="prt" name="scala.collection.TraversableLike#Self" data-isabs="false"> + <a id="Self:Self"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">type</span> + </span> + <span class="symbol"> + <span class="name">Self</span><span class="result"> = <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashMap#+" data-isabs="false"> + <a id="+[B1>:B]((A, B1)):Map[A, B1]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus">+</span><span class="tparams">[<span name="B1">B1 >: B</span>]</span><span class="params">(<span name="kv">kv: (A, B1)</span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B1]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashMap" class="extype" href="">TimeStampedHashMap</a> → MapLike → MapLike → GenMapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.MapLike#+" data-isabs="false"> + <a id="+[B1>:B]((A, B1),(A, B1),(A, B1)*):Map[A, B1]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus">+</span><span class="tparams">[<span name="B1">B1 >: B</span>]</span><span class="params">(<span name="elem1">elem1: (A, B1)</span>, <span name="elem2">elem2: (A, B1)</span>, <span name="elems">elems: (A, B1)*</span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B1]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → MapLike</dd><dt>Annotations</dt><dd> + <span class="name">@migration</span> + + </dd><dt>Migration</dt><dd class="cmt"><p><i>(Changed in version 2.8.0)</i> <code>+</code> creates a new map. Use <code>+=</code> to add an element to this map and return that map itself.</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.MapLike#++" data-isabs="false"> + <a id="++[B1>:B](GenTraversableOnce[(A, B1)]):Map[A, B1]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="tparams">[<span name="B1">B1 >: B</span>]</span><span class="params">(<span name="xs">xs: <span name="scala.collection.GenTraversableOnce" class="extype">GenTraversableOnce</span>[(A, B1)]</span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B1]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → MapLike</dd><dt>Annotations</dt><dd> + <span class="name">@migration</span> + + </dd><dt>Migration</dt><dd class="cmt"><p><i>(Changed in version 2.8.0)</i> <code>++</code> creates a new map. Use <code>++=</code> to add an element to this map and return that map itself.</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#++" data-isabs="false"> + <a id="++[B>:(A, B), That](GenTraversableOnce[B])(CanBuildFrom[Map[A, B], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="tparams">[<span name="B">B >: (A, B)</span>, <span name="That">That</span>]</span><span class="params">(<span name="that">that: <span name="scala.collection.GenTraversableOnce" class="extype">GenTraversableOnce</span>[B]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#++:" data-isabs="false"> + <a id="++:[B>:(A, B), That](Traversable[B])(CanBuildFrom[Map[A, B], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus$colon">++:</span><span class="tparams">[<span name="B">B >: (A, B)</span>, <span name="That">That</span>]</span><span class="params">(<span name="that">that: <span name="scala.collection.Traversable" class="extype">Traversable</span>[B]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#++:" data-isabs="false"> + <a id="++:[B>:(A, B), That](TraversableOnce[B])(CanBuildFrom[Map[A, B], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus$colon">++:</span><span class="tparams">[<span name="B">B >: (A, B)</span>, <span name="That">That</span>]</span><span class="params">(<span name="that">that: <span name="scala.collection.TraversableOnce" class="extype">TraversableOnce</span>[B]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.Growable#++=" data-isabs="false"> + <a id="++=(TraversableOnce[(A, B)]):TimeStampedHashMap.this.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus$eq">++=</span><span class="params">(<span name="xs">xs: <span name="scala.collection.TraversableOnce" class="extype">TraversableOnce</span>[(A, B)]</span>)</span><span class="result">: TimeStampedHashMap.this.type</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Growable</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashMap#+=" data-isabs="false"> + <a id="+=((A, B)):TimeStampedHashMap.this.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$eq">+=</span><span class="params">(<span name="kv">kv: (A, B)</span>)</span><span class="result">: TimeStampedHashMap.this.type</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashMap" class="extype" href="">TimeStampedHashMap</a> → MapLike → Builder → Growable</dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.Growable#+=" data-isabs="false"> + <a id="+=((A, B),(A, B),(A, B)*):TimeStampedHashMap.this.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$eq">+=</span><span class="params">(<span name="elem1">elem1: (A, B)</span>, <span name="elem2">elem2: (A, B)</span>, <span name="elems">elems: (A, B)*</span>)</span><span class="result">: TimeStampedHashMap.this.type</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Growable</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashMap#-" data-isabs="false"> + <a id="-(A):Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $minus">-</span><span class="params">(<span name="key">key: A</span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashMap" class="extype" href="">TimeStampedHashMap</a> → MapLike → MapLike → Subtractable → GenMapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.MapLike#-" data-isabs="false"> + <a id="-(A,A,A*):Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $minus">-</span><span class="params">(<span name="elem1">elem1: A</span>, <span name="elem2">elem2: A</span>, <span name="elems">elems: A*</span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → Subtractable</dd><dt>Annotations</dt><dd> + <span class="name">@migration</span> + + </dd><dt>Migration</dt><dd class="cmt"><p><i>(Changed in version 2.8.0)</i> <code>-</code> creates a new map. Use <code>-=</code> to remove an element from this map and return that map itself.</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.MapLike#--" data-isabs="false"> + <a id="--(GenTraversableOnce[A]):Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $minus$minus">--</span><span class="params">(<span name="xs">xs: <span name="scala.collection.GenTraversableOnce" class="extype">GenTraversableOnce</span>[A]</span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → Subtractable</dd><dt>Annotations</dt><dd> + <span class="name">@migration</span> + + </dd><dt>Migration</dt><dd class="cmt"><p><i>(Changed in version 2.8.0)</i> <code>--</code> creates a new map. Use <code>--=</code> to remove an element from this map and return that map itself.</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.Shrinkable#--=" data-isabs="false"> + <a id="--=(TraversableOnce[A]):TimeStampedHashMap.this.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $minus$minus$eq">--=</span><span class="params">(<span name="xs">xs: <span name="scala.collection.TraversableOnce" class="extype">TraversableOnce</span>[A]</span>)</span><span class="result">: TimeStampedHashMap.this.type</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Shrinkable</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashMap#-=" data-isabs="false"> + <a id="-=(A):TimeStampedHashMap.this.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $minus$eq">-=</span><span class="params">(<span name="key">key: A</span>)</span><span class="result">: TimeStampedHashMap.this.type</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashMap" class="extype" href="">TimeStampedHashMap</a> → MapLike → Shrinkable</dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.Shrinkable#-=" data-isabs="false"> + <a id="-=(A,A,A*):TimeStampedHashMap.this.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $minus$eq">-=</span><span class="params">(<span name="elem1">elem1: A</span>, <span name="elem2">elem2: A</span>, <span name="elems">elems: A*</span>)</span><span class="result">: TimeStampedHashMap.this.type</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Shrinkable</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#/:" data-isabs="false"> + <a id="/:[B](B)((B, (A, B)) ⇒ B):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $div$colon">/:</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="op">op: (B, (A, B)) ⇒ B</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.GenTraversableOnce#/:\" data-isabs="false"> + <a id="/:\[A1>:(A, B)](A1)((A1, A1) ⇒ A1):A1"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $div$colon$bslash">/:\</span><span class="tparams">[<span name="A1">A1 >: (A, B)</span>]</span><span class="params">(<span name="z">z: A1</span>)</span><span class="params">(<span name="op">op: (A1, A1) ⇒ A1</span>)</span><span class="result">: A1</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#:\" data-isabs="false"> + <a id=":\[B](B)(((A, B), B) ⇒ B):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $colon$bslash">:\</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="op">op: ((A, B), B) ⇒ B</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#addString" data-isabs="false"> + <a id="addString(StringBuilder,String,String,String):StringBuilder"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addString</span><span class="params">(<span name="b">b: StringBuilder</span>, <span name="start">start: String</span>, <span name="sep">sep: String</span>, <span name="end">end: String</span>)</span><span class="result">: StringBuilder</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → TraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#addString" data-isabs="false"> + <a id="addString(StringBuilder):StringBuilder"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addString</span><span class="params">(<span name="b">b: StringBuilder</span>)</span><span class="result">: StringBuilder</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#addString" data-isabs="false"> + <a id="addString(StringBuilder,String):StringBuilder"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addString</span><span class="params">(<span name="b">b: StringBuilder</span>, <span name="sep">sep: String</span>)</span><span class="result">: StringBuilder</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#aggregate" data-isabs="false"> + <a id="aggregate[B](B)((B, (A, B)) ⇒ B,(B, B) ⇒ B):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="seqop">seqop: (B, (A, B)) ⇒ B</span>, <span name="combop">combop: (B, B) ⇒ B</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.PartialFunction#andThen" data-isabs="false"> + <a id="andThen[C]((B) ⇒ C):PartialFunction[A, C]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">andThen</span><span class="tparams">[<span name="C">C</span>]</span><span class="params">(<span name="k">k: (B) ⇒ C</span>)</span><span class="result">: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[A, C]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>PartialFunction → Function1</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashMap#apply" data-isabs="false"> + <a id="apply(A):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="key">key: A</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashMap" class="extype" href="">TimeStampedHashMap</a> → MapLike → Function1 → GenMapLike</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="that">that: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → Equals</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.MapLike#clear" data-isabs="false"> + <a id="clear():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clear</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → Builder → Growable</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashMap#clearOldValues" data-isabs="false"> + <a id="clearOldValues(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearOldValues</span><span class="params">(<span name="threshTime">threshTime: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Removes old key-value pairs that have timestamp earlier than <code>threshTime</code> +</p> + </li><li visbl="pub" name="scala.collection.mutable.MapLike#clone" data-isabs="false"> + <a id="clone():Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → Cloneable → AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#collect" data-isabs="false"> + <a id="collect[B, That](PartialFunction[(A, B), B])(CanBuildFrom[Map[A, B], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="tparams">[<span name="B">B</span>, <span name="That">That</span>]</span><span class="params">(<span name="pf">pf: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[(A, B), B]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#collectFirst" data-isabs="false"> + <a id="collectFirst[B](PartialFunction[(A, B), B]):Option[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collectFirst</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="pf">pf: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[(A, B), B]</span>)</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.Iterable#companion" data-isabs="false"> + <a id="companion:GenericCompanion[Iterable]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">companion</span><span class="result">: <span name="scala.collection.generic.GenericCompanion" class="extype">GenericCompanion</span>[<span name="scala.collection.mutable.Iterable" class="extype">Iterable</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Iterable → Iterable → GenIterable → Traversable → Traversable → GenTraversable → GenericTraversableTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.Function1#compose" data-isabs="false"> + <a id="compose[A]((A) ⇒ A):(A) ⇒ B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compose</span><span class="tparams">[<span name="A">A</span>]</span><span class="params">(<span name="g">g: (A) ⇒ A</span>)</span><span class="result">: (A) ⇒ B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1</dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#contains" data-isabs="false"> + <a id="contains(A):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">contains</span><span class="params">(<span name="key">key: A</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#copyToArray" data-isabs="false"> + <a id="copyToArray[B>:(A, B)](Array[B],Int,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">copyToArray</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span name="xs">xs: <span name="scala.Array" class="extype">Array</span>[B]</span>, <span name="start">start: <span name="scala.Int" class="extype">Int</span></span>, <span name="len">len: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#copyToArray" data-isabs="false"> + <a id="copyToArray[B>:(A, B)](Array[B]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">copyToArray</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span name="xs">xs: <span name="scala.Array" class="extype">Array</span>[B]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#copyToArray" data-isabs="false"> + <a id="copyToArray[B>:(A, B)](Array[B],Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">copyToArray</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span name="xs">xs: <span name="scala.Array" class="extype">Array</span>[B]</span>, <span name="start">start: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#copyToBuffer" data-isabs="false"> + <a id="copyToBuffer[B>:(A, B)](Buffer[B]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">copyToBuffer</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span name="dest">dest: <span name="scala.collection.mutable.Buffer" class="extype">Buffer</span>[B]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#count" data-isabs="false"> + <a id="count(((A, B)) ⇒ Boolean):Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">(<span name="p">p: ((A, B)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#default" data-isabs="false"> + <a id="default(A):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">default</span><span class="params">(<span name="key">key: A</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → GenMapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#drop" data-isabs="false"> + <a id="drop(Int):Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">drop</span><span class="params">(<span name="n">n: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#dropRight" data-isabs="false"> + <a id="dropRight(Int):Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dropRight</span><span class="params">(<span name="n">n: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#dropWhile" data-isabs="false"> + <a id="dropWhile(((A, B)) ⇒ Boolean):Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dropWhile</span><span class="params">(<span name="p">p: ((A, B)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashMap#empty" data-isabs="false"> + <a id="empty:Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">empty</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashMap" class="extype" href="">TimeStampedHashMap</a> → Map → Map → MapLike</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.collection.GenMapLike#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="that">that: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenMapLike → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#exists" data-isabs="false"> + <a id="exists(((A, B)) ⇒ Boolean):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">exists</span><span class="params">(<span name="p">p: ((A, B)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashMap#filter" data-isabs="false"> + <a id="filter(((A, B)) ⇒ Boolean):Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="p">p: ((A, B)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashMap" class="extype" href="">TimeStampedHashMap</a> → TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#filterKeys" data-isabs="false"> + <a id="filterKeys((A) ⇒ Boolean):Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filterKeys</span><span class="params">(<span name="p">p: (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#filterNot" data-isabs="false"> + <a id="filterNot(((A, B)) ⇒ Boolean):Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filterNot</span><span class="params">(<span name="p">p: ((A, B)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#find" data-isabs="false"> + <a id="find(((A, B)) ⇒ Boolean):Option[(A, B)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">find</span><span class="params">(<span name="p">p: ((A, B)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[(A, B)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#flatMap" data-isabs="false"> + <a id="flatMap[B, That](((A, B)) ⇒ GenTraversableOnce[B])(CanBuildFrom[Map[A, B], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="B">B</span>, <span name="That">That</span>]</span><span class="params">(<span name="f">f: ((A, B)) ⇒ <span name="scala.collection.GenTraversableOnce" class="extype">GenTraversableOnce</span>[B]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike → FilterMonadic</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#fold" data-isabs="false"> + <a id="fold[A1>:(A, B)](A1)((A1, A1) ⇒ A1):A1"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="tparams">[<span name="A1">A1 >: (A, B)</span>]</span><span class="params">(<span name="z">z: A1</span>)</span><span class="params">(<span name="op">op: (A1, A1) ⇒ A1</span>)</span><span class="result">: A1</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#foldLeft" data-isabs="false"> + <a id="foldLeft[B](B)((B, (A, B)) ⇒ B):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foldLeft</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="op">op: (B, (A, B)) ⇒ B</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#foldRight" data-isabs="false"> + <a id="foldRight[B](B)(((A, B), B) ⇒ B):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foldRight</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="op">op: ((A, B), B) ⇒ B</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#forall" data-isabs="false"> + <a id="forall(((A, B)) ⇒ Boolean):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">forall</span><span class="params">(<span name="p">p: ((A, B)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashMap#foreach" data-isabs="false"> + <a id="foreach[U](((A, B)) ⇒ U):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: ((A, B)) ⇒ U</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashMap" class="extype" href="">TimeStampedHashMap</a> → IterableLike → GenericTraversableTemplate → TraversableLike → GenTraversableLike → TraversableOnce → GenTraversableOnce → FilterMonadic</dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.GenericTraversableTemplate#genericBuilder" data-isabs="false"> + <a id="genericBuilder[B]:Builder[B, Iterable[B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">genericBuilder</span><span class="tparams">[<span name="B">B</span>]</span><span class="result">: <span name="scala.collection.mutable.Builder" class="extype">Builder</span>[B, <span name="scala.collection.mutable.Iterable" class="extype">Iterable</span>[B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenericTraversableTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashMap#get" data-isabs="false"> + <a id="get(A):Option[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">get</span><span class="params">(<span name="key">key: A</span>)</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashMap" class="extype" href="">TimeStampedHashMap</a> → MapLike → GenMapLike</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#getOrElse" data-isabs="false"> + <a id="getOrElse[B1>:B](A,⇒ B1):B1"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getOrElse</span><span class="tparams">[<span name="B1">B1 >: B</span>]</span><span class="params">(<span name="key">key: A</span>, <span name="default">default: ⇒ B1</span>)</span><span class="result">: B1</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.MapLike#getOrElseUpdate" data-isabs="false"> + <a id="getOrElseUpdate(A,⇒ B):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getOrElseUpdate</span><span class="params">(<span name="key">key: A</span>, <span name="op">op: ⇒ B</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#groupBy" data-isabs="false"> + <a id="groupBy[K](((A, B)) ⇒ K):Map[K, Map[A, B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: ((A, B)) ⇒ K</span>)</span><span class="result">: <span name="scala.collection.immutable.Map" class="extype">Map</span>[K, <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#grouped" data-isabs="false"> + <a id="grouped(Int):Iterator[Map[A, B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">grouped</span><span class="params">(<span name="size">size: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#hasDefiniteSize" data-isabs="false"> + <a id="hasDefiniteSize:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hasDefiniteSize</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.GenMapLike#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenMapLike → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#head" data-isabs="false"> + <a id="head:(A, B)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">head</span><span class="result">: (A, B)</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → GenIterableLike → TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#headOption" data-isabs="false"> + <a id="headOption:Option[(A, B)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">headOption</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[(A, B)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#init" data-isabs="false"> + <a id="init:Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">init</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#initLogging" data-isabs="false"> + <a id="initLogging():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">initLogging</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#inits" data-isabs="false"> + <a id="inits:Iterator[Map[A, B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">inits</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashMap#internalMap" data-isabs="false"> + <a id="internalMap:ConcurrentHashMap[A, (B, Long)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">internalMap</span><span class="result">: <span name="java.util.concurrent.ConcurrentHashMap" class="extype">ConcurrentHashMap</span>[A, (B, <span name="scala.Long" class="extype">Long</span>)]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.collection.MapLike#isDefinedAt" data-isabs="false"> + <a id="isDefinedAt(A):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isDefinedAt</span><span class="params">(<span name="key">key: A</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → PartialFunction</dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#isEmpty" data-isabs="false"> + <a id="isEmpty:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isEmpty</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → IterableLike → GenIterableLike → TraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.collection.GenTraversableLike#isTraversableAgain" data-isabs="false"> + <a id="isTraversableAgain:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isTraversableAgain</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenTraversableLike → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashMap#iterator" data-isabs="false"> + <a id="iterator:Iterator[(A, B)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="result">: Iterator[(A, B)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashMap" class="extype" href="">TimeStampedHashMap</a> → MapLike → IterableLike → GenIterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#keySet" data-isabs="false"> + <a id="keySet:Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keySet</span><span class="result">: <span name="scala.collection.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#keys" data-isabs="false"> + <a id="keys:Iterable[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keys</span><span class="result">: <span name="scala.collection.Iterable" class="extype">Iterable</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd><dt>Annotations</dt><dd> + <span class="name">@migration</span> + + </dd><dt>Migration</dt><dd class="cmt"><p><i>(Changed in version 2.8.0)</i> <code>keys</code> returns <code>Iterable[A]</code> rather than <code>Iterator[A]</code>.</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#keysIterator" data-isabs="false"> + <a id="keysIterator:Iterator[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">keysIterator</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#last" data-isabs="false"> + <a id="last:(A, B)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">last</span><span class="result">: (A, B)</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#lastOption" data-isabs="false"> + <a id="lastOption:Option[(A, B)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">lastOption</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[(A, B)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.PartialFunction#lift" data-isabs="false"> + <a id="lift:(A) ⇒ Option[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">lift</span><span class="result">: (A) ⇒ <span name="scala.Option" class="extype">Option</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>PartialFunction</dd></dl></div> + </li><li visbl="prt" name="spark.Logging#log" data-isabs="false"> + <a id="log:Logger"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">log</span><span class="result">: <span name="org.slf4j.Logger" class="extype">Logger</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logDebug" data-isabs="false"> + <a id="logDebug(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logDebug</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logError" data-isabs="false"> + <a id="logError(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logError</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logInfo" data-isabs="false"> + <a id="logInfo(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logInfo</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logTrace" data-isabs="false"> + <a id="logTrace(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logTrace</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String,Throwable):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>, <span name="throwable">throwable: Throwable</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="prt" name="spark.Logging#logWarning" data-isabs="false"> + <a id="logWarning(⇒ String):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">logWarning</span><span class="params">(<span name="msg">msg: ⇒ String</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd><a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#map" data-isabs="false"> + <a id="map[B, That](((A, B)) ⇒ B)(CanBuildFrom[Map[A, B], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="B">B</span>, <span name="That">That</span>]</span><span class="params">(<span name="f">f: ((A, B)) ⇒ B</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike → FilterMonadic</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.Builder#mapResult" data-isabs="false"> + <a id="mapResult[NewTo]((Map[A, B]) ⇒ NewTo):Builder[(A, B), NewTo]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapResult</span><span class="tparams">[<span name="NewTo">NewTo</span>]</span><span class="params">(<span name="f">f: (<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]) ⇒ NewTo</span>)</span><span class="result">: <span name="scala.collection.mutable.Builder" class="extype">Builder</span>[(A, B), NewTo]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Builder</dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#mapValues" data-isabs="false"> + <a id="mapValues[C]((B) ⇒ C):Map[A, C]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapValues</span><span class="tparams">[<span name="C">C</span>]</span><span class="params">(<span name="f">f: (B) ⇒ C</span>)</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[A, C]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#max" data-isabs="false"> + <a id="max[B>:(A, B)](Ordering[B]):(A, B)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">max</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="cmp">cmp: Ordering[B]</span>)</span><span class="result">: (A, B)</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#maxBy" data-isabs="false"> + <a id="maxBy[B](((A, B)) ⇒ B)(Ordering[B]):(A, B)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">maxBy</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="f">f: ((A, B)) ⇒ B</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="cmp">cmp: Ordering[B]</span>)</span><span class="result">: (A, B)</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#min" data-isabs="false"> + <a id="min[B>:(A, B)](Ordering[B]):(A, B)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">min</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="cmp">cmp: Ordering[B]</span>)</span><span class="result">: (A, B)</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#minBy" data-isabs="false"> + <a id="minBy[B](((A, B)) ⇒ B)(Ordering[B]):(A, B)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">minBy</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="f">f: ((A, B)) ⇒ B</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="cmp">cmp: Ordering[B]</span>)</span><span class="result">: (A, B)</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#mkString" data-isabs="false"> + <a id="mkString:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mkString</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#mkString" data-isabs="false"> + <a id="mkString(String):String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mkString</span><span class="params">(<span name="sep">sep: String</span>)</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#mkString" data-isabs="false"> + <a id="mkString(String,String,String):String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mkString</span><span class="params">(<span name="start">start: String</span>, <span name="sep">sep: String</span>, <span name="end">end: String</span>)</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="scala.collection.mutable.MapLike#newBuilder" data-isabs="false"> + <a id="newBuilder:Builder[(A, B), Map[A, B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">newBuilder</span><span class="result">: <span name="scala.collection.mutable.Builder" class="extype">Builder</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[this] </dd><dt>Definition Classes</dt><dd>MapLike → MapLike → TraversableLike → HasNewBuilder</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#nonEmpty" data-isabs="false"> + <a id="nonEmpty:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">nonEmpty</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.PartialFunction#orElse" data-isabs="false"> + <a id="orElse[A1<:A, B1>:B](PartialFunction[A1, B1]):PartialFunction[A1, B1]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">orElse</span><span class="tparams">[<span name="A1">A1 <: A</span>, <span name="B1">B1 >: B</span>]</span><span class="params">(<span name="that">that: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[A1, B1]</span>)</span><span class="result">: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[A1, B1]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>PartialFunction</dd></dl></div> + </li><li visbl="pub" name="scala.collection.Parallelizable#par" data-isabs="false"> + <a id="par:ParMap[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">par</span><span class="result">: <span name="scala.collection.parallel.mutable.ParMap" class="extype">ParMap</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Parallelizable</dd></dl></div> + </li><li visbl="prt" name="scala.collection.mutable.MapLike#parCombiner" data-isabs="false"> + <a id="parCombiner:Combiner[(A, B), ParMap[A, B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">parCombiner</span><span class="result">: <span name="scala.collection.parallel.Combiner" class="extype">Combiner</span>[(A, B), <span name="scala.collection.parallel.mutable.ParMap" class="extype">ParMap</span>[A, B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[this] </dd><dt>Definition Classes</dt><dd>MapLike → MapLike → TraversableLike → Parallelizable</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#partition" data-isabs="false"> + <a id="partition(((A, B)) ⇒ Boolean):(Map[A, B], Map[A, B])"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">partition</span><span class="params">(<span name="p">p: ((A, B)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: (<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B])</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#product" data-isabs="false"> + <a id="product[B>:(A, B)](Numeric[B]):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">product</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="num">num: Numeric[B]</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.MapLike#put" data-isabs="false"> + <a id="put(A,B):Option[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">put</span><span class="params">(<span name="key">key: A</span>, <span name="value">value: B</span>)</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#reduce" data-isabs="false"> + <a id="reduce[A1>:(A, B)]((A1, A1) ⇒ A1):A1"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="tparams">[<span name="A1">A1 >: (A, B)</span>]</span><span class="params">(<span name="op">op: (A1, A1) ⇒ A1</span>)</span><span class="result">: A1</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#reduceLeft" data-isabs="false"> + <a id="reduceLeft[B>:(A, B)]((B, (A, B)) ⇒ B):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceLeft</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span name="op">op: (B, (A, B)) ⇒ B</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#reduceLeftOption" data-isabs="false"> + <a id="reduceLeftOption[B>:(A, B)]((B, (A, B)) ⇒ B):Option[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceLeftOption</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span name="op">op: (B, (A, B)) ⇒ B</span>)</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#reduceOption" data-isabs="false"> + <a id="reduceOption[A1>:(A, B)]((A1, A1) ⇒ A1):Option[A1]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceOption</span><span class="tparams">[<span name="A1">A1 >: (A, B)</span>]</span><span class="params">(<span name="op">op: (A1, A1) ⇒ A1</span>)</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[A1]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#reduceRight" data-isabs="false"> + <a id="reduceRight[B>:(A, B)](((A, B), B) ⇒ B):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceRight</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span name="op">op: ((A, B), B) ⇒ B</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#reduceRightOption" data-isabs="false"> + <a id="reduceRightOption[B>:(A, B)](((A, B), B) ⇒ B):Option[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceRightOption</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span name="op">op: ((A, B), B) ⇒ B</span>)</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.MapLike#remove" data-isabs="false"> + <a id="remove(A):Option[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">remove</span><span class="params">(<span name="key">key: A</span>)</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#repr" data-isabs="false"> + <a id="repr:Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">repr</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.MapLike#result" data-isabs="false"> + <a id="result():Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">result</span><span class="params">()</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → Builder</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.MapLike#retain" data-isabs="false"> + <a id="retain((A, B) ⇒ Boolean):TimeStampedHashMap.this.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">retain</span><span class="params">(<span name="p">p: (A, B) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: TimeStampedHashMap.this.type</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd></dl></div> + </li><li visbl="prt" name="scala.collection.TraversableOnce#reversed" data-isabs="false"> + <a id="reversed:List[(A, B)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reversed</span><span class="result">: List[(A, B)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[this] </dd><dt>Definition Classes</dt><dd>TraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#sameElements" data-isabs="false"> + <a id="sameElements[B>:(A, B)](GenIterable[B]):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sameElements</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span name="that">that: <span name="scala.collection.GenIterable" class="extype">GenIterable</span>[B]</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → GenIterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#scan" data-isabs="false"> + <a id="scan[B>:(A, B), That](B)((B, B) ⇒ B)(CanBuildFrom[Map[A, B], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">scan</span><span class="tparams">[<span name="B">B >: (A, B)</span>, <span name="That">That</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="op">op: (B, B) ⇒ B</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="cbf">cbf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#scanLeft" data-isabs="false"> + <a id="scanLeft[B, That](B)((B, (A, B)) ⇒ B)(CanBuildFrom[Map[A, B], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">scanLeft</span><span class="tparams">[<span name="B">B</span>, <span name="That">That</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="op">op: (B, (A, B)) ⇒ B</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#scanRight" data-isabs="false"> + <a id="scanRight[B, That](B)(((A, B), B) ⇒ B)(CanBuildFrom[Map[A, B], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">scanRight</span><span class="tparams">[<span name="B">B</span>, <span name="That">That</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="op">op: ((A, B), B) ⇒ B</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd><dt>Annotations</dt><dd> + <span class="name">@migration</span> + + </dd><dt>Migration</dt><dd class="cmt"><p><i>(Changed in version 2.9.0)</i> The behavior of <code>scanRight</code> has changed. The previous behavior can be reproduced with scanRight.reverse.</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.Map#seq" data-isabs="false"> + <a id="seq:Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">seq</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Map → Map → GenMap → GenMapLike → Iterable → Iterable → GenIterable → Traversable → Traversable → GenTraversable → Parallelizable → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashMap#size" data-isabs="false"> + <a id="size:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">size</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashMap" class="extype" href="">TimeStampedHashMap</a> → GenTraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.Builder#sizeHint" data-isabs="false"> + <a id="sizeHint(scala.collection.TraversableLike[_, _],Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sizeHint</span><span class="params">(<span name="coll">coll: scala.collection.TraversableLike[_, _]</span>, <span name="delta">delta: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Builder</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.Builder#sizeHint" data-isabs="false"> + <a id="sizeHint(Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sizeHint</span><span class="params">(<span name="size">size: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Builder</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.Builder#sizeHintBounded" data-isabs="false"> + <a id="sizeHintBounded(Int,scala.collection.TraversableLike[_, _]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sizeHintBounded</span><span class="params">(<span name="size">size: <span name="scala.Int" class="extype">Int</span></span>, <span name="boundingColl">boundingColl: scala.collection.TraversableLike[_, _]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Builder</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#slice" data-isabs="false"> + <a id="slice(Int,Int):Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">slice</span><span class="params">(<span name="from">from: <span name="scala.Int" class="extype">Int</span></span>, <span name="until">until: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#sliding" data-isabs="false"> + <a id="sliding[B>:(A, B)](Int,Int):Iterator[Map[A, B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sliding</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span name="size">size: <span name="scala.Int" class="extype">Int</span></span>, <span name="step">step: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#sliding" data-isabs="false"> + <a id="sliding[B>:(A, B)](Int):Iterator[Map[A, B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sliding</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span name="size">size: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#span" data-isabs="false"> + <a id="span(((A, B)) ⇒ Boolean):(Map[A, B], Map[A, B])"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">span</span><span class="params">(<span name="p">p: ((A, B)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: (<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B])</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#splitAt" data-isabs="false"> + <a id="splitAt(Int):(Map[A, B], Map[A, B])"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">splitAt</span><span class="params">(<span name="n">n: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: (<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B])</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#stringPrefix" data-isabs="false"> + <a id="stringPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">stringPrefix</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#sum" data-isabs="false"> + <a id="sum[B>:(A, B)](Numeric[B]):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sum</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="num">num: Numeric[B]</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#tail" data-isabs="false"> + <a id="tail:Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">tail</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#tails" data-isabs="false"> + <a id="tails:Iterator[Map[A, B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">tails</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#take" data-isabs="false"> + <a id="take(Int):Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="n">n: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#takeRight" data-isabs="false"> + <a id="takeRight(Int):Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeRight</span><span class="params">(<span name="n">n: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#takeWhile" data-isabs="false"> + <a id="takeWhile(((A, B)) ⇒ Boolean):Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeWhile</span><span class="params">(<span name="p">p: ((A, B)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="prt" name="scala.collection.IterableLike#thisCollection" data-isabs="false"> + <a id="thisCollection:Iterable[(A, B)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">thisCollection</span><span class="result">: <span name="scala.collection.Iterable" class="extype">Iterable</span>[(A, B)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[this] </dd><dt>Definition Classes</dt><dd>IterableLike → TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#toArray" data-isabs="false"> + <a id="toArray[B>:(A, B)](ClassManifest[B]):Array[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[B]</span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#toBuffer" data-isabs="false"> + <a id="toBuffer[C>:(A, B)]:Buffer[C]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toBuffer</span><span class="tparams">[<span name="C">C >: (A, B)</span>]</span><span class="result">: <span name="scala.collection.mutable.Buffer" class="extype">Buffer</span>[C]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="prt" name="scala.collection.IterableLike#toCollection" data-isabs="false"> + <a id="toCollection(Map[A, B]):Iterable[(A, B)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toCollection</span><span class="params">(<span name="repr">repr: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span>)</span><span class="result">: <span name="scala.collection.Iterable" class="extype">Iterable</span>[(A, B)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[this] </dd><dt>Definition Classes</dt><dd>IterableLike → TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#toIndexedSeq" data-isabs="false"> + <a id="toIndexedSeq[B>:(A, B)]:IndexedSeq[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toIndexedSeq</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="result">: <span name="scala.collection.immutable.IndexedSeq" class="extype">IndexedSeq</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#toIterable" data-isabs="false"> + <a id="toIterable:Iterable[(A, B)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toIterable</span><span class="result">: <span name="scala.collection.Iterable" class="extype">Iterable</span>[(A, B)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#toIterator" data-isabs="false"> + <a id="toIterator:Iterator[(A, B)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toIterator</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[(A, B)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#toList" data-isabs="false"> + <a id="toList:List[(A, B)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toList</span><span class="result">: List[(A, B)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#toMap" data-isabs="false"> + <a id="toMap[T, U](<:<[(A, B), (T, U)]):Map[T, U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toMap</span><span class="tparams">[<span name="T">T</span>, <span name="U">U</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="ev">ev: <span name="scala.Predef.<:<" class="extype"><:<</span>[(A, B), (T, U)]</span>)</span><span class="result">: <span name="scala.collection.immutable.Map" class="extype">Map</span>[T, U]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#toSeq" data-isabs="false"> + <a id="toSeq:Seq[(A, B)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toSeq</span><span class="result">: <span name="scala.collection.Seq" class="extype">Seq</span>[(A, B)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#toSet" data-isabs="false"> + <a id="toSet[B>:(A, B)]:Set[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toSet</span><span class="tparams">[<span name="B">B >: (A, B)</span>]</span><span class="result">: <span name="scala.collection.immutable.Set" class="extype">Set</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#toStream" data-isabs="false"> + <a id="toStream:Stream[(A, B)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toStream</span><span class="result">: <span name="scala.collection.immutable.Stream" class="extype">Stream</span>[(A, B)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → TraversableLike → Function1 → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#toTraversable" data-isabs="false"> + <a id="toTraversable:Traversable[(A, B)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toTraversable</span><span class="result">: <span name="scala.collection.Traversable" class="extype">Traversable</span>[(A, B)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.MapLike#transform" data-isabs="false"> + <a id="transform((A, B) ⇒ B):TimeStampedHashMap.this.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">transform</span><span class="params">(<span name="f">f: (A, B) ⇒ B</span>)</span><span class="result">: TimeStampedHashMap.this.type</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.GenericTraversableTemplate#transpose" data-isabs="false"> + <a id="transpose[B](((A, B)) ⇒ GenTraversableOnce[B]):Iterable[Iterable[B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">transpose</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="asTraversable">asTraversable: ((A, B)) ⇒ <span name="scala.collection.GenTraversableOnce" class="extype">GenTraversableOnce</span>[B]</span>)</span><span class="result">: <span name="scala.collection.mutable.Iterable" class="extype">Iterable</span>[<span name="scala.collection.mutable.Iterable" class="extype">Iterable</span>[B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenericTraversableTemplate</dd><dt>Annotations</dt><dd> + <span class="name">@migration</span> + + </dd><dt>Migration</dt><dd class="cmt"><p><i>(Changed in version 2.9.0)</i> <code>transpose</code> throws an <code>IllegalArgumentException</code> if collections are not uniformly sized.</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.GenericTraversableTemplate#unzip" data-isabs="false"> + <a id="unzip[A1, A2](((A, B)) ⇒ (A1, A2)):(Iterable[A1], Iterable[A2])"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">unzip</span><span class="tparams">[<span name="A1">A1</span>, <span name="A2">A2</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="asPair">asPair: ((A, B)) ⇒ (A1, A2)</span>)</span><span class="result">: (<span name="scala.collection.mutable.Iterable" class="extype">Iterable</span>[A1], <span name="scala.collection.mutable.Iterable" class="extype">Iterable</span>[A2])</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenericTraversableTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.GenericTraversableTemplate#unzip3" data-isabs="false"> + <a id="unzip3[A1, A2, A3](((A, B)) ⇒ (A1, A2, A3)):(Iterable[A1], Iterable[A2], Iterable[A3])"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">unzip3</span><span class="tparams">[<span name="A1">A1</span>, <span name="A2">A2</span>, <span name="A3">A3</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="asTriple">asTriple: ((A, B)) ⇒ (A1, A2, A3)</span>)</span><span class="result">: (<span name="scala.collection.mutable.Iterable" class="extype">Iterable</span>[A1], <span name="scala.collection.mutable.Iterable" class="extype">Iterable</span>[A2], <span name="scala.collection.mutable.Iterable" class="extype">Iterable</span>[A3])</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenericTraversableTemplate</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashMap#update" data-isabs="false"> + <a id="update(A,B):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">update</span><span class="params">(<span name="key">key: A</span>, <span name="value">value: B</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashMap" class="extype" href="">TimeStampedHashMap</a> → MapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.MapLike#updated" data-isabs="false"> + <a id="updated[B1>:B](A,B1):Map[A, B1]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">updated</span><span class="tparams">[<span name="B1">B1 >: B</span>]</span><span class="params">(<span name="key">key: A</span>, <span name="value">value: B1</span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B1]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike → MapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#values" data-isabs="false"> + <a id="values:Iterable[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">values</span><span class="result">: <span name="scala.collection.Iterable" class="extype">Iterable</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd><dt>Annotations</dt><dd> + <span class="name">@migration</span> + + </dd><dt>Migration</dt><dd class="cmt"><p><i>(Changed in version 2.8.0)</i> <code>values</code> returns <code>Iterable[B]</code> rather than <code>Iterator[B]</code>.</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#valuesIterator" data-isabs="false"> + <a id="valuesIterator:Iterator[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">valuesIterator</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#view" data-isabs="false"> + <a id="view(Int,Int):IterableView[(A, B), Map[A, B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">view</span><span class="params">(<span name="from">from: <span name="scala.Int" class="extype">Int</span></span>, <span name="until">until: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.IterableView" class="extype">IterableView</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#view" data-isabs="false"> + <a id="view:IterableView[(A, B), Map[A, B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">view</span><span class="result">: <span name="scala.collection.IterableView" class="extype">IterableView</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.Map#withDefault" data-isabs="false"> + <a id="withDefault((A) ⇒ B):Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">withDefault</span><span class="params">(<span name="d">d: (A) ⇒ B</span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Map</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.Map#withDefaultValue" data-isabs="false"> + <a id="withDefaultValue(B):Map[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">withDefaultValue</span><span class="params">(<span name="d">d: B</span>)</span><span class="result">: <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Map</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#withFilter" data-isabs="false"> + <a id="withFilter(((A, B)) ⇒ Boolean):FilterMonadic[(A, B), Map[A, B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">withFilter</span><span class="params">(<span name="p">p: ((A, B)) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.collection.generic.FilterMonadic" class="extype">FilterMonadic</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → FilterMonadic</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#zip" data-isabs="false"> + <a id="zip[A1>:(A, B), B, That](GenIterable[B])(CanBuildFrom[Map[A, B], (A1, B), That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="A1">A1 >: (A, B)</span>, <span name="B">B</span>, <span name="That">That</span>]</span><span class="params">(<span name="that">that: <span name="scala.collection.GenIterable" class="extype">GenIterable</span>[B]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], (A1, B), That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → GenIterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#zipAll" data-isabs="false"> + <a id="zipAll[B, A1>:(A, B), That](GenIterable[B],A1,B)(CanBuildFrom[Map[A, B], (A1, B), That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zipAll</span><span class="tparams">[<span name="B">B</span>, <span name="A1">A1 >: (A, B)</span>, <span name="That">That</span>]</span><span class="params">(<span name="that">that: <span name="scala.collection.GenIterable" class="extype">GenIterable</span>[B]</span>, <span name="thisElem">thisElem: A1</span>, <span name="thatElem">thatElem: B</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], (A1, B), That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → GenIterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#zipWithIndex" data-isabs="false"> + <a id="zipWithIndex[A1>:(A, B), That](CanBuildFrom[Map[A, B], (A1, Int), That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zipWithIndex</span><span class="tparams">[<span name="A1">A1 >: (A, B)</span>, <span name="That">That</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B], (A1, <span name="scala.Int" class="extype">Int</span>), That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → GenIterableLike</dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.collection.IterableLike#elements" data-isabs="false"> + <a id="elements:Iterator[(A, B)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use iterator' instead">elements</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[(A, B)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use <code>iterator' instead</code></p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#first" data-isabs="false"> + <a id="first:(A, B)"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use head' instead">first</span><span class="result">: (A, B)</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use <code>head' instead</code></p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#firstOption" data-isabs="false"> + <a id="firstOption:Option[(A, B)]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use headOption' instead">firstOption</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[(A, B)]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use <code>headOption' instead</code></p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.MapLike#mapElements" data-isabs="false"> + <a id="mapElements[C]((B) ⇒ C):Map[A, C]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use mapValues' instead">mapElements</span><span class="tparams">[<span name="C">C</span>]</span><span class="params">(<span name="f">f: (B) ⇒ C</span>)</span><span class="result">: <span name="scala.collection.Map" class="extype">Map</span>[A, C]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use <code>mapValues' instead</code></p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#projection" data-isabs="false"> + <a id="projection:IterableView[(A, B), Map[A, B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use view' instead">projection</span><span class="result">: <span name="scala.collection.IterableView" class="extype">IterableView</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use <code>view' instead</code></p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.MapLike#removeKey" data-isabs="false"> + <a id="removeKey(A):Option[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) Use remove' instead">removeKey</span><span class="params">(<span name="key">key: A</span>)</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>MapLike</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> Use <code>remove' instead</code></p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="spark.Logging" class="parent"> + <h3>Inherited from <a name="spark.Logging" class="extype" href="../Logging.html">Logging</a></h3> + </div><div name="scala.collection.mutable.Map" class="parent"> + <h3>Inherited from <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]</h3> + </div><div name="scala.collection.mutable.MapLike" class="parent"> + <h3>Inherited from <span name="scala.collection.mutable.MapLike" class="extype">MapLike</span>[A, B, <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</h3> + </div><div name="scala.collection.mutable.Cloneable" class="parent"> + <h3>Inherited from <span name="scala.collection.mutable.Cloneable" class="extype">Cloneable</span>[<span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</h3> + </div><div name="scala.collection.generic.Shrinkable" class="parent"> + <h3>Inherited from <span name="scala.collection.generic.Shrinkable" class="extype">Shrinkable</span>[A]</h3> + </div><div name="scala.collection.mutable.Builder" class="parent"> + <h3>Inherited from <span name="scala.collection.mutable.Builder" class="extype">Builder</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</h3> + </div><div name="scala.collection.generic.Growable" class="parent"> + <h3>Inherited from <span name="scala.collection.generic.Growable" class="extype">Growable</span>[(A, B)]</h3> + </div><div name="scala.collection.Map" class="parent"> + <h3>Inherited from <span name="scala.collection.Map" class="extype">Map</span>[A, B]</h3> + </div><div name="scala.collection.MapLike" class="parent"> + <h3>Inherited from <span name="scala.collection.MapLike" class="extype">MapLike</span>[A, B, <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</h3> + </div><div name="scala.collection.generic.Subtractable" class="parent"> + <h3>Inherited from <span name="scala.collection.generic.Subtractable" class="extype">Subtractable</span>[A, <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</h3> + </div><div name="scala.PartialFunction" class="parent"> + <h3>Inherited from <span name="scala.PartialFunction" class="extype">PartialFunction</span>[A, B]</h3> + </div><div name="scala.Function1" class="parent"> + <h3>Inherited from (A) ⇒ B</h3> + </div><div name="scala.collection.GenMap" class="parent"> + <h3>Inherited from <span name="scala.collection.GenMap" class="extype">GenMap</span>[A, B]</h3> + </div><div name="scala.collection.GenMapLike" class="parent"> + <h3>Inherited from <span name="scala.collection.GenMapLike" class="extype">GenMapLike</span>[A, B, <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</h3> + </div><div name="scala.collection.mutable.Iterable" class="parent"> + <h3>Inherited from <span name="scala.collection.mutable.Iterable" class="extype">Iterable</span>[(A, B)]</h3> + </div><div name="scala.collection.Iterable" class="parent"> + <h3>Inherited from <span name="scala.collection.Iterable" class="extype">Iterable</span>[(A, B)]</h3> + </div><div name="scala.collection.IterableLike" class="parent"> + <h3>Inherited from <span name="scala.collection.IterableLike" class="extype">IterableLike</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.collection.GenIterable" class="parent"> + <h3>Inherited from <span name="scala.collection.GenIterable" class="extype">GenIterable</span>[(A, B)]</h3> + </div><div name="scala.collection.GenIterableLike" class="parent"> + <h3>Inherited from <span name="scala.collection.GenIterableLike" class="extype">GenIterableLike</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</h3> + </div><div name="scala.collection.mutable.Traversable" class="parent"> + <h3>Inherited from <span name="scala.collection.mutable.Traversable" class="extype">Traversable</span>[(A, B)]</h3> + </div><div name="scala.Mutable" class="parent"> + <h3>Inherited from <span name="scala.Mutable" class="extype">Mutable</span></h3> + </div><div name="scala.collection.Traversable" class="parent"> + <h3>Inherited from <span name="scala.collection.Traversable" class="extype">Traversable</span>[(A, B)]</h3> + </div><div name="scala.collection.GenTraversable" class="parent"> + <h3>Inherited from <span name="scala.collection.GenTraversable" class="extype">GenTraversable</span>[(A, B)]</h3> + </div><div name="scala.collection.generic.GenericTraversableTemplate" class="parent"> + <h3>Inherited from <span name="scala.collection.generic.GenericTraversableTemplate" class="extype">GenericTraversableTemplate</span>[(A, B), <span name="scala.collection.mutable.Iterable" class="extype">Iterable</span>]</h3> + </div><div name="scala.collection.TraversableLike" class="parent"> + <h3>Inherited from <span name="scala.collection.TraversableLike" class="extype">TraversableLike</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</h3> + </div><div name="scala.collection.GenTraversableLike" class="parent"> + <h3>Inherited from <span name="scala.collection.GenTraversableLike" class="extype">GenTraversableLike</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</h3> + </div><div name="scala.collection.Parallelizable" class="parent"> + <h3>Inherited from <span name="scala.collection.Parallelizable" class="extype">Parallelizable</span>[(A, B), <span name="scala.collection.parallel.mutable.ParMap" class="extype">ParMap</span>[A, B]]</h3> + </div><div name="scala.collection.TraversableOnce" class="parent"> + <h3>Inherited from <span name="scala.collection.TraversableOnce" class="extype">TraversableOnce</span>[(A, B)]</h3> + </div><div name="scala.collection.GenTraversableOnce" class="parent"> + <h3>Inherited from <span name="scala.collection.GenTraversableOnce" class="extype">GenTraversableOnce</span>[(A, B)]</h3> + </div><div name="scala.collection.generic.FilterMonadic" class="parent"> + <h3>Inherited from <span name="scala.collection.generic.FilterMonadic" class="extype">FilterMonadic</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</h3> + </div><div name="scala.collection.generic.HasNewBuilder" class="parent"> + <h3>Inherited from <span name="scala.collection.generic.HasNewBuilder" class="extype">HasNewBuilder</span>[(A, B), <span name="scala.collection.mutable.Map" class="extype">Map</span>[A, B]]</h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/util/TimeStampedHashSet.html b/site/docs/0.7.0/api/core/spark/util/TimeStampedHashSet.html new file mode 100644 index 000000000..96919f7d2 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/util/TimeStampedHashSet.html @@ -0,0 +1,2298 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.util.TimeStampedHashSet</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.util" class="extype" href="package.html">util</a></p> + <h1>TimeStampedHashSet</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">TimeStampedHashSet</span><span class="tparams">[<span name="A">A</span>]</span><span class="result"> extends <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.collection.mutable.Set" class="extype">Set</span>[A], <span name="scala.collection.mutable.SetLike" class="extype">SetLike</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]], <span name="scala.collection.mutable.Cloneable" class="extype">Cloneable</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A]], <span name="scala.collection.generic.Shrinkable" class="extype">Shrinkable</span>[A], <span name="scala.collection.mutable.Builder" class="extype">Builder</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]], <span name="scala.collection.generic.Growable" class="extype">Growable</span>[A], <span name="scala.collection.script.Scriptable" class="extype">Scriptable</span>[A], <span name="scala.collection.Set" class="extype">Set</span>[A], <span name="scala.collection.SetLike" class="extype">SetLike</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]], <span name="scala.collection.generic.Subtractable" class="extype">Subtractable</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]], <span name="scala.collection.GenSet" class="extype">GenSet</span>[A], <span name="scala.collection.generic.GenericSetTemplate" class="extype">GenericSetTemplate</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>], <span name="scala.collection.GenSetLike" class="extype">GenSetLike</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]], (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span>, <span name="scala.collection.mutable.Iterable" class="extype">Iterable</span>[A], <span name="scala.collection.Iterable" class="extype">Iterable</span>[A], <span name="scala.collection.IterableLike" class="extype">IterableLike</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]], <span name="scala.Equals" class="extype">Equals</span>, <span name="scala.collection.GenIterable" class="extype">GenIterable</span>[A], <span name="scala.collection.GenIterableLike" class="extype">GenIterableLike</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]], <span name="scala.collection.mutable.Traversable" class="extype">Traversable</span>[A], <span name="scala.Mutable" class="extype">Mutable</span>, <span name="scala.collection.Traversable" class="extype">Traversable</span>[A], <span name="scala.collection.GenTraversable" class="extype">GenTraversable</span>[A], <span name="scala.collection.generic.GenericTraversableTemplate" class="extype">GenericTraversableTemplate</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>], <span name="scala.collection.TraversableLike" class="extype">TraversableLike</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]], <span name="scala.collection.GenTraversableLike" class="extype">GenTraversableLike</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]], <span name="scala.collection.Parallelizable" class="extype">Parallelizable</span>[A, <span name="scala.collection.parallel.mutable.ParSet" class="extype">ParSet</span>[A]], <span name="scala.collection.TraversableOnce" class="extype">TraversableOnce</span>[A], <span name="scala.collection.GenTraversableOnce" class="extype">GenTraversableOnce</span>[A], <span name="scala.collection.generic.FilterMonadic" class="extype">FilterMonadic</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]], <span name="scala.collection.generic.HasNewBuilder" class="extype">HasNewBuilder</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]], AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.util.TimeStampedHashSet" class="in"><span>TimeStampedHashSet</span></li><li name="scala.collection.mutable.Set" class="in"><span>Set</span></li><li name="scala.collection.mutable.SetLike" class="in"><span>SetLike</span></li><li name="scala.collection.mutable.Cloneable" class="in"><span>Cloneable</span></li><li name="scala.collection.generic.Shrinkable" class="in"><span>Shrinkable</span></li><li name="scala.collection.mutable.Builder" class="in"><span>Builder</span></li><li name="scala.collection.generic.Growable" class="in"><span>Growable</span></li><li name="scala.collection.script.Scriptable" class="in"><span>Scriptable</span></li><li name="scala.collection.Set" class="in"><span>Set</span></li><li name="scala.collection.SetLike" class="in"><span>SetLike</span></li><li name="scala.collection.generic.Subtractable" class="in"><span>Subtractable</span></li><li name="scala.collection.GenSet" class="in"><span>GenSet</span></li><li name="scala.collection.generic.GenericSetTemplate" class="in"><span>GenericSetTemplate</span></li><li name="scala.collection.GenSetLike" class="in"><span>GenSetLike</span></li><li name="scala.Function1" class="in"><span>Function1</span></li><li name="scala.collection.mutable.Iterable" class="in"><span>Iterable</span></li><li name="scala.collection.Iterable" class="in"><span>Iterable</span></li><li name="scala.collection.IterableLike" class="in"><span>IterableLike</span></li><li name="scala.Equals" class="in"><span>Equals</span></li><li name="scala.collection.GenIterable" class="in"><span>GenIterable</span></li><li name="scala.collection.GenIterableLike" class="in"><span>GenIterableLike</span></li><li name="scala.collection.mutable.Traversable" class="in"><span>Traversable</span></li><li name="scala.Mutable" class="in"><span>Mutable</span></li><li name="scala.collection.Traversable" class="in"><span>Traversable</span></li><li name="scala.collection.GenTraversable" class="in"><span>GenTraversable</span></li><li name="scala.collection.generic.GenericTraversableTemplate" class="in"><span>GenericTraversableTemplate</span></li><li name="scala.collection.TraversableLike" class="in"><span>TraversableLike</span></li><li name="scala.collection.GenTraversableLike" class="in"><span>GenTraversableLike</span></li><li name="scala.collection.Parallelizable" class="in"><span>Parallelizable</span></li><li name="scala.collection.TraversableOnce" class="in"><span>TraversableOnce</span></li><li name="scala.collection.GenTraversableOnce" class="in"><span>GenTraversableOnce</span></li><li name="scala.collection.generic.FilterMonadic" class="in"><span>FilterMonadic</span></li><li name="scala.collection.generic.HasNewBuilder" class="in"><span>HasNewBuilder</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.util.TimeStampedHashSet#this" data-isabs="false"> + <a id="this:TimeStampedHashSet[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">TimeStampedHashSet</span><span class="params">()</span> + </span> + </h4> + + </li></ol> + </div> + + <div class="types members" id="types"> + <h3>Type Members</h3> + <ol><li visbl="prt" name="scala.collection.TraversableLike#Self" data-isabs="false"> + <a id="Self:Self"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">type</span> + </span> + <span class="symbol"> + <span class="name">Self</span><span class="result"> = <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.collection.GenSetLike#&" data-isabs="false"> + <a id="&(GenSet[A]):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $amp">&</span><span class="params">(<span name="that">that: <span name="scala.collection.GenSet" class="extype">GenSet</span>[A]</span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenSetLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.GenSetLike#&~" data-isabs="false"> + <a id="&~(GenSet[A]):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $amp$tilde">&~</span><span class="params">(<span name="that">that: <span name="scala.collection.GenSet" class="extype">GenSet</span>[A]</span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenSetLike</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashSet#+" data-isabs="false"> + <a id="+(A):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus">+</span><span class="params">(<span name="elem">elem: A</span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashSet" class="extype" href="">TimeStampedHashSet</a> → SetLike → SetLike → GenSetLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.SetLike#+" data-isabs="false"> + <a id="+(A,A,A*):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus">+</span><span class="params">(<span name="elem1">elem1: A</span>, <span name="elem2">elem2: A</span>, <span name="elems">elems: A*</span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → SetLike</dd><dt>Annotations</dt><dd> + <span class="name">@migration</span> + + </dd><dt>Migration</dt><dd class="cmt"><p><i>(Changed in version 2.8.0)</i> <code>+</code> creates a new set. Use <code>+=</code> to add an element to this set and return that set itself.</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.SetLike#++" data-isabs="false"> + <a id="++(GenTraversableOnce[A]):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="params">(<span name="xs">xs: <span name="scala.collection.GenTraversableOnce" class="extype">GenTraversableOnce</span>[A]</span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → SetLike</dd><dt>Annotations</dt><dd> + <span class="name">@migration</span> + + </dd><dt>Migration</dt><dd class="cmt"><p><i>(Changed in version 2.8.0)</i> <code>++</code> creates a new set. Use <code>++=</code> to add elements to this set and return that set itself.</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#++" data-isabs="false"> + <a id="++[B>:A, That](GenTraversableOnce[B])(CanBuildFrom[Set[A], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus">++</span><span class="tparams">[<span name="B">B >: A</span>, <span name="That">That</span>]</span><span class="params">(<span name="that">that: <span name="scala.collection.GenTraversableOnce" class="extype">GenTraversableOnce</span>[B]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#++:" data-isabs="false"> + <a id="++:[B>:A, That](Traversable[B])(CanBuildFrom[Set[A], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus$colon">++:</span><span class="tparams">[<span name="B">B >: A</span>, <span name="That">That</span>]</span><span class="params">(<span name="that">that: <span name="scala.collection.Traversable" class="extype">Traversable</span>[B]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#++:" data-isabs="false"> + <a id="++:[B>:A, That](TraversableOnce[B])(CanBuildFrom[Set[A], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus$colon">++:</span><span class="tparams">[<span name="B">B >: A</span>, <span name="That">That</span>]</span><span class="params">(<span name="that">that: <span name="scala.collection.TraversableOnce" class="extype">TraversableOnce</span>[B]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.Growable#++=" data-isabs="false"> + <a id="++=(TraversableOnce[A]):TimeStampedHashSet.this.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$plus$eq">++=</span><span class="params">(<span name="xs">xs: <span name="scala.collection.TraversableOnce" class="extype">TraversableOnce</span>[A]</span>)</span><span class="result">: TimeStampedHashSet.this.type</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Growable</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashSet#+=" data-isabs="false"> + <a id="+=(A):TimeStampedHashSet.this.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$eq">+=</span><span class="params">(<span name="key">key: A</span>)</span><span class="result">: TimeStampedHashSet.this.type</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashSet" class="extype" href="">TimeStampedHashSet</a> → SetLike → Builder → Growable</dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.Growable#+=" data-isabs="false"> + <a id="+=(A,A,A*):TimeStampedHashSet.this.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$eq">+=</span><span class="params">(<span name="elem1">elem1: A</span>, <span name="elem2">elem2: A</span>, <span name="elems">elems: A*</span>)</span><span class="result">: TimeStampedHashSet.this.type</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Growable</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashSet#-" data-isabs="false"> + <a id="-(A):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $minus">-</span><span class="params">(<span name="elem">elem: A</span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashSet" class="extype" href="">TimeStampedHashSet</a> → SetLike → SetLike → Subtractable → GenSetLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.SetLike#-" data-isabs="false"> + <a id="-(A,A,A*):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $minus">-</span><span class="params">(<span name="elem1">elem1: A</span>, <span name="elem2">elem2: A</span>, <span name="elems">elems: A*</span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → Subtractable</dd><dt>Annotations</dt><dd> + <span class="name">@migration</span> + + </dd><dt>Migration</dt><dd class="cmt"><p><i>(Changed in version 2.8.0)</i> <code>-</code> creates a new set. Use <code>-=</code> to remove an element from this set and return that set itself.</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.SetLike#--" data-isabs="false"> + <a id="--(GenTraversableOnce[A]):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $minus$minus">--</span><span class="params">(<span name="xs">xs: <span name="scala.collection.GenTraversableOnce" class="extype">GenTraversableOnce</span>[A]</span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → Subtractable</dd><dt>Annotations</dt><dd> + <span class="name">@migration</span> + + </dd><dt>Migration</dt><dd class="cmt"><p><i>(Changed in version 2.8.0)</i> <code>--</code> creates a new set. Use <code>--=</code> to remove elements from this set and return that set itself.</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.Shrinkable#--=" data-isabs="false"> + <a id="--=(TraversableOnce[A]):TimeStampedHashSet.this.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $minus$minus$eq">--=</span><span class="params">(<span name="xs">xs: <span name="scala.collection.TraversableOnce" class="extype">TraversableOnce</span>[A]</span>)</span><span class="result">: TimeStampedHashSet.this.type</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Shrinkable</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashSet#-=" data-isabs="false"> + <a id="-=(A):TimeStampedHashSet.this.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $minus$eq">-=</span><span class="params">(<span name="key">key: A</span>)</span><span class="result">: TimeStampedHashSet.this.type</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashSet" class="extype" href="">TimeStampedHashSet</a> → SetLike → Shrinkable</dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.Shrinkable#-=" data-isabs="false"> + <a id="-=(A,A,A*):TimeStampedHashSet.this.type"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $minus$eq">-=</span><span class="params">(<span name="elem1">elem1: A</span>, <span name="elem2">elem2: A</span>, <span name="elems">elems: A*</span>)</span><span class="result">: TimeStampedHashSet.this.type</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Shrinkable</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#/:" data-isabs="false"> + <a id="/:[B](B)((B, A) ⇒ B):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $div$colon">/:</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="op">op: (B, A) ⇒ B</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.GenTraversableOnce#/:\" data-isabs="false"> + <a id="/:\[A1>:A](A1)((A1, A1) ⇒ A1):A1"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $div$colon$bslash">/:\</span><span class="tparams">[<span name="A1">A1 >: A</span>]</span><span class="params">(<span name="z">z: A1</span>)</span><span class="params">(<span name="op">op: (A1, A1) ⇒ A1</span>)</span><span class="result">: A1</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#:\" data-isabs="false"> + <a id=":\[B](B)((A, B) ⇒ B):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $colon$bslash">:\</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="op">op: (A, B) ⇒ B</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.SetLike#<<" data-isabs="false"> + <a id="<<(Message[A]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $less$less"><<</span><span class="params">(<span name="cmd">cmd: <span name="scala.collection.script.Message" class="extype">Message</span>[A]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → Scriptable</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.SetLike#add" data-isabs="false"> + <a id="add(A):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">add</span><span class="params">(<span name="elem">elem: A</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#addString" data-isabs="false"> + <a id="addString(StringBuilder):StringBuilder"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addString</span><span class="params">(<span name="b">b: StringBuilder</span>)</span><span class="result">: StringBuilder</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#addString" data-isabs="false"> + <a id="addString(StringBuilder,String):StringBuilder"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addString</span><span class="params">(<span name="b">b: StringBuilder</span>, <span name="sep">sep: String</span>)</span><span class="result">: StringBuilder</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#addString" data-isabs="false"> + <a id="addString(StringBuilder,String,String,String):StringBuilder"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addString</span><span class="params">(<span name="b">b: StringBuilder</span>, <span name="start">start: String</span>, <span name="sep">sep: String</span>, <span name="end">end: String</span>)</span><span class="result">: StringBuilder</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#aggregate" data-isabs="false"> + <a id="aggregate[B](B)((B, A) ⇒ B,(B, B) ⇒ B):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">aggregate</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="seqop">seqop: (B, A) ⇒ B</span>, <span name="combop">combop: (B, B) ⇒ B</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.Function1#andThen" data-isabs="false"> + <a id="andThen[A]((Boolean) ⇒ A):(A) ⇒ A"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">andThen</span><span class="tparams">[<span name="A">A</span>]</span><span class="params">(<span name="g">g: (<span name="scala.Boolean" class="extype">Boolean</span>) ⇒ A</span>)</span><span class="result">: (A) ⇒ A</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1</dd></dl></div> + </li><li visbl="pub" name="scala.collection.GenSetLike#apply" data-isabs="false"> + <a id="apply(A):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="elem">elem: A</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenSetLike → Function1</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#canEqual" data-isabs="false"> + <a id="canEqual(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">canEqual</span><span class="params">(<span name="that">that: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → Equals</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.SetLike#clear" data-isabs="false"> + <a id="clear():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clear</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → Builder → Growable</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashSet#clearOldValues" data-isabs="false"> + <a id="clearOldValues(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clearOldValues</span><span class="params">(<span name="threshTime">threshTime: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <p class="shortcomment cmt">Removes old values that have timestamp earlier than <code>threshTime</code> +</p> + </li><li visbl="pub" name="scala.collection.mutable.SetLike#clone" data-isabs="false"> + <a id="clone():Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → Cloneable → AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#collect" data-isabs="false"> + <a id="collect[B, That](PartialFunction[A, B])(CanBuildFrom[Set[A], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collect</span><span class="tparams">[<span name="B">B</span>, <span name="That">That</span>]</span><span class="params">(<span name="pf">pf: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[A, B]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#collectFirst" data-isabs="false"> + <a id="collectFirst[B](PartialFunction[A, B]):Option[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">collectFirst</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="pf">pf: <span name="scala.PartialFunction" class="extype">PartialFunction</span>[A, B]</span>)</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.Set#companion" data-isabs="false"> + <a id="companion:GenericCompanion[Set]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">companion</span><span class="result">: <span name="scala.collection.generic.GenericCompanion" class="extype">GenericCompanion</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Set → Set → GenSet → Iterable → Iterable → GenIterable → Traversable → Traversable → GenTraversable → GenericTraversableTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.Function1#compose" data-isabs="false"> + <a id="compose[A]((A) ⇒ A):(A) ⇒ Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">compose</span><span class="tparams">[<span name="A">A</span>]</span><span class="params">(<span name="g">g: (A) ⇒ A</span>)</span><span class="result">: (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Function1</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashSet#contains" data-isabs="false"> + <a id="contains(A):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">contains</span><span class="params">(<span name="key">key: A</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashSet" class="extype" href="">TimeStampedHashSet</a> → SetLike → GenSetLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#copyToArray" data-isabs="false"> + <a id="copyToArray[B>:A](Array[B],Int,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">copyToArray</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span name="xs">xs: <span name="scala.Array" class="extype">Array</span>[B]</span>, <span name="start">start: <span name="scala.Int" class="extype">Int</span></span>, <span name="len">len: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#copyToArray" data-isabs="false"> + <a id="copyToArray[B>:A](Array[B]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">copyToArray</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span name="xs">xs: <span name="scala.Array" class="extype">Array</span>[B]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#copyToArray" data-isabs="false"> + <a id="copyToArray[B>:A](Array[B],Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">copyToArray</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span name="xs">xs: <span name="scala.Array" class="extype">Array</span>[B]</span>, <span name="start">start: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#copyToBuffer" data-isabs="false"> + <a id="copyToBuffer[B>:A](Buffer[B]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">copyToBuffer</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span name="dest">dest: <span name="scala.collection.mutable.Buffer" class="extype">Buffer</span>[B]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#count" data-isabs="false"> + <a id="count((A) ⇒ Boolean):Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">count</span><span class="params">(<span name="p">p: (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.SetLike#diff" data-isabs="false"> + <a id="diff(GenSet[A]):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">diff</span><span class="params">(<span name="that">that: <span name="scala.collection.GenSet" class="extype">GenSet</span>[A]</span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → GenSetLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#drop" data-isabs="false"> + <a id="drop(Int):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">drop</span><span class="params">(<span name="n">n: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#dropRight" data-isabs="false"> + <a id="dropRight(Int):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dropRight</span><span class="params">(<span name="n">n: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#dropWhile" data-isabs="false"> + <a id="dropWhile((A) ⇒ Boolean):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dropWhile</span><span class="params">(<span name="p">p: (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashSet#empty" data-isabs="false"> + <a id="empty:Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">empty</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashSet" class="extype" href="">TimeStampedHashSet</a> → SetLike → GenericSetTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.collection.GenSetLike#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="that">that: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenSetLike → Equals → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#exists" data-isabs="false"> + <a id="exists((A) ⇒ Boolean):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">exists</span><span class="params">(<span name="p">p: (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#filter" data-isabs="false"> + <a id="filter((A) ⇒ Boolean):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filter</span><span class="params">(<span name="p">p: (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#filterNot" data-isabs="false"> + <a id="filterNot((A) ⇒ Boolean):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">filterNot</span><span class="params">(<span name="p">p: (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#find" data-isabs="false"> + <a id="find((A) ⇒ Boolean):Option[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">find</span><span class="params">(<span name="p">p: (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#flatMap" data-isabs="false"> + <a id="flatMap[B, That]((A) ⇒ GenTraversableOnce[B])(CanBuildFrom[Set[A], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">flatMap</span><span class="tparams">[<span name="B">B</span>, <span name="That">That</span>]</span><span class="params">(<span name="f">f: (A) ⇒ <span name="scala.collection.GenTraversableOnce" class="extype">GenTraversableOnce</span>[B]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike → FilterMonadic</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#fold" data-isabs="false"> + <a id="fold[A1>:A](A1)((A1, A1) ⇒ A1):A1"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">fold</span><span class="tparams">[<span name="A1">A1 >: A</span>]</span><span class="params">(<span name="z">z: A1</span>)</span><span class="params">(<span name="op">op: (A1, A1) ⇒ A1</span>)</span><span class="result">: A1</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#foldLeft" data-isabs="false"> + <a id="foldLeft[B](B)((B, A) ⇒ B):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foldLeft</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="op">op: (B, A) ⇒ B</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#foldRight" data-isabs="false"> + <a id="foldRight[B](B)((A, B) ⇒ B):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foldRight</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="op">op: (A, B) ⇒ B</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#forall" data-isabs="false"> + <a id="forall((A) ⇒ Boolean):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">forall</span><span class="params">(<span name="p">p: (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashSet#foreach" data-isabs="false"> + <a id="foreach[U]((A) ⇒ U):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">foreach</span><span class="tparams">[<span name="U">U</span>]</span><span class="params">(<span name="f">f: (A) ⇒ U</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashSet" class="extype" href="">TimeStampedHashSet</a> → IterableLike → GenericTraversableTemplate → TraversableLike → GenTraversableLike → TraversableOnce → GenTraversableOnce → FilterMonadic</dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.GenericTraversableTemplate#genericBuilder" data-isabs="false"> + <a id="genericBuilder[B]:Builder[B, Set[B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">genericBuilder</span><span class="tparams">[<span name="B">B</span>]</span><span class="result">: <span name="scala.collection.mutable.Builder" class="extype">Builder</span>[B, <span name="scala.collection.mutable.Set" class="extype">Set</span>[B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenericTraversableTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#groupBy" data-isabs="false"> + <a id="groupBy[K]((A) ⇒ K):Map[K, Set[A]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">groupBy</span><span class="tparams">[<span name="K">K</span>]</span><span class="params">(<span name="f">f: (A) ⇒ K</span>)</span><span class="result">: <span name="scala.collection.immutable.Map" class="extype">Map</span>[K, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#grouped" data-isabs="false"> + <a id="grouped(Int):Iterator[Set[A]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">grouped</span><span class="params">(<span name="size">size: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#hasDefiniteSize" data-isabs="false"> + <a id="hasDefiniteSize:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hasDefiniteSize</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.GenSetLike#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenSetLike → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#head" data-isabs="false"> + <a id="head:A"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">head</span><span class="result">: A</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → GenIterableLike → TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#headOption" data-isabs="false"> + <a id="headOption:Option[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">headOption</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#init" data-isabs="false"> + <a id="init:Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">init</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#inits" data-isabs="false"> + <a id="inits:Iterator[Set[A]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">inits</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashSet#internalMap" data-isabs="false"> + <a id="internalMap:ConcurrentHashMap[A, Long]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">internalMap</span><span class="result">: <span name="java.util.concurrent.ConcurrentHashMap" class="extype">ConcurrentHashMap</span>[A, <span name="scala.Long" class="extype">Long</span>]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.collection.GenSetLike#intersect" data-isabs="false"> + <a id="intersect(GenSet[A]):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">intersect</span><span class="params">(<span name="that">that: <span name="scala.collection.GenSet" class="extype">GenSet</span>[A]</span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenSetLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.SetLike#isEmpty" data-isabs="false"> + <a id="isEmpty:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isEmpty</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → IterableLike → GenIterableLike → TraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.collection.GenTraversableLike#isTraversableAgain" data-isabs="false"> + <a id="isTraversableAgain:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isTraversableAgain</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenTraversableLike → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashSet#iterator" data-isabs="false"> + <a id="iterator:Iterator[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">iterator</span><span class="result">: Iterator[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashSet" class="extype" href="">TimeStampedHashSet</a> → GenSetLike → IterableLike → GenIterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#last" data-isabs="false"> + <a id="last:A"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">last</span><span class="result">: A</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#lastOption" data-isabs="false"> + <a id="lastOption:Option[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">lastOption</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.SetLike#map" data-isabs="false"> + <a id="map[B, That]((A) ⇒ B)(CanBuildFrom[Set[A], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">map</span><span class="tparams">[<span name="B">B</span>, <span name="That">That</span>]</span><span class="params">(<span name="f">f: (A) ⇒ B</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → TraversableLike → GenTraversableLike → FilterMonadic</dd><dt>Annotations</dt><dd> + <span class="name">@migration</span> + + </dd><dt>Migration</dt><dd class="cmt"><p><i>(Changed in version 2.8.0)</i> Set.map now returns a Set, so it will discard duplicate values.</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.Builder#mapResult" data-isabs="false"> + <a id="mapResult[NewTo]((Set[A]) ⇒ NewTo):Builder[A, NewTo]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mapResult</span><span class="tparams">[<span name="NewTo">NewTo</span>]</span><span class="params">(<span name="f">f: (<span name="scala.collection.mutable.Set" class="extype">Set</span>[A]) ⇒ NewTo</span>)</span><span class="result">: <span name="scala.collection.mutable.Builder" class="extype">Builder</span>[A, NewTo]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Builder</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#max" data-isabs="false"> + <a id="max[B>:A](Ordering[B]):A"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">max</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="cmp">cmp: Ordering[B]</span>)</span><span class="result">: A</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#maxBy" data-isabs="false"> + <a id="maxBy[B]((A) ⇒ B)(Ordering[B]):A"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">maxBy</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="f">f: (A) ⇒ B</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="cmp">cmp: Ordering[B]</span>)</span><span class="result">: A</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#min" data-isabs="false"> + <a id="min[B>:A](Ordering[B]):A"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">min</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="cmp">cmp: Ordering[B]</span>)</span><span class="result">: A</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#minBy" data-isabs="false"> + <a id="minBy[B]((A) ⇒ B)(Ordering[B]):A"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">minBy</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span name="f">f: (A) ⇒ B</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="cmp">cmp: Ordering[B]</span>)</span><span class="result">: A</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#mkString" data-isabs="false"> + <a id="mkString:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mkString</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#mkString" data-isabs="false"> + <a id="mkString(String):String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mkString</span><span class="params">(<span name="sep">sep: String</span>)</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#mkString" data-isabs="false"> + <a id="mkString(String,String,String):String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">mkString</span><span class="params">(<span name="start">start: String</span>, <span name="sep">sep: String</span>, <span name="end">end: String</span>)</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="scala.collection.mutable.SetLike#newBuilder" data-isabs="false"> + <a id="newBuilder:Builder[A, Set[A]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">newBuilder</span><span class="result">: <span name="scala.collection.mutable.Builder" class="extype">Builder</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[this] </dd><dt>Definition Classes</dt><dd>SetLike → SetLike → TraversableLike → HasNewBuilder</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#nonEmpty" data-isabs="false"> + <a id="nonEmpty:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">nonEmpty</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.collection.Parallelizable#par" data-isabs="false"> + <a id="par:ParSet[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">par</span><span class="result">: <span name="scala.collection.parallel.mutable.ParSet" class="extype">ParSet</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Parallelizable</dd></dl></div> + </li><li visbl="prt" name="scala.collection.mutable.SetLike#parCombiner" data-isabs="false"> + <a id="parCombiner:Combiner[A, ParSet[A]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">parCombiner</span><span class="result">: <span name="scala.collection.parallel.Combiner" class="extype">Combiner</span>[A, <span name="scala.collection.parallel.mutable.ParSet" class="extype">ParSet</span>[A]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[this] </dd><dt>Definition Classes</dt><dd>SetLike → SetLike → TraversableLike → Parallelizable</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#partition" data-isabs="false"> + <a id="partition((A) ⇒ Boolean):(Set[A], Set[A])"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">partition</span><span class="params">(<span name="p">p: (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: (<span name="scala.collection.mutable.Set" class="extype">Set</span>[A], <span name="scala.collection.mutable.Set" class="extype">Set</span>[A])</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#product" data-isabs="false"> + <a id="product[B>:A](Numeric[B]):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">product</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="num">num: Numeric[B]</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#reduce" data-isabs="false"> + <a id="reduce[A1>:A]((A1, A1) ⇒ A1):A1"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduce</span><span class="tparams">[<span name="A1">A1 >: A</span>]</span><span class="params">(<span name="op">op: (A1, A1) ⇒ A1</span>)</span><span class="result">: A1</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#reduceLeft" data-isabs="false"> + <a id="reduceLeft[B>:A]((B, A) ⇒ B):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceLeft</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span name="op">op: (B, A) ⇒ B</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#reduceLeftOption" data-isabs="false"> + <a id="reduceLeftOption[B>:A]((B, A) ⇒ B):Option[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceLeftOption</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span name="op">op: (B, A) ⇒ B</span>)</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#reduceOption" data-isabs="false"> + <a id="reduceOption[A1>:A]((A1, A1) ⇒ A1):Option[A1]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceOption</span><span class="tparams">[<span name="A1">A1 >: A</span>]</span><span class="params">(<span name="op">op: (A1, A1) ⇒ A1</span>)</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[A1]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#reduceRight" data-isabs="false"> + <a id="reduceRight[B>:A]((A, B) ⇒ B):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceRight</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span name="op">op: (A, B) ⇒ B</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#reduceRightOption" data-isabs="false"> + <a id="reduceRightOption[B>:A]((A, B) ⇒ B):Option[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reduceRightOption</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span name="op">op: (A, B) ⇒ B</span>)</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.SetLike#remove" data-isabs="false"> + <a id="remove(A):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">remove</span><span class="params">(<span name="elem">elem: A</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#repr" data-isabs="false"> + <a id="repr:Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">repr</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.SetLike#result" data-isabs="false"> + <a id="result():Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">result</span><span class="params">()</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → Builder</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.SetLike#retain" data-isabs="false"> + <a id="retain((A) ⇒ Boolean):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">retain</span><span class="params">(<span name="p">p: (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike</dd></dl></div> + </li><li visbl="prt" name="scala.collection.TraversableOnce#reversed" data-isabs="false"> + <a id="reversed:List[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">reversed</span><span class="result">: List[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[this] </dd><dt>Definition Classes</dt><dd>TraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#sameElements" data-isabs="false"> + <a id="sameElements[B>:A](GenIterable[B]):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sameElements</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span name="that">that: <span name="scala.collection.GenIterable" class="extype">GenIterable</span>[B]</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → GenIterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#scan" data-isabs="false"> + <a id="scan[B>:A, That](B)((B, B) ⇒ B)(CanBuildFrom[Set[A], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">scan</span><span class="tparams">[<span name="B">B >: A</span>, <span name="That">That</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="op">op: (B, B) ⇒ B</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="cbf">cbf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#scanLeft" data-isabs="false"> + <a id="scanLeft[B, That](B)((B, A) ⇒ B)(CanBuildFrom[Set[A], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">scanLeft</span><span class="tparams">[<span name="B">B</span>, <span name="That">That</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="op">op: (B, A) ⇒ B</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#scanRight" data-isabs="false"> + <a id="scanRight[B, That](B)((A, B) ⇒ B)(CanBuildFrom[Set[A], B, That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">scanRight</span><span class="tparams">[<span name="B">B</span>, <span name="That">That</span>]</span><span class="params">(<span name="z">z: B</span>)</span><span class="params">(<span name="op">op: (A, B) ⇒ B</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A], B, That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd><dt>Annotations</dt><dd> + <span class="name">@migration</span> + + </dd><dt>Migration</dt><dd class="cmt"><p><i>(Changed in version 2.9.0)</i> The behavior of <code>scanRight</code> has changed. The previous behavior can be reproduced with scanRight.reverse.</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.Set#seq" data-isabs="false"> + <a id="seq:Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">seq</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Set → Set → GenSet → GenSetLike → Iterable → Iterable → GenIterable → Traversable → Traversable → GenTraversable → Parallelizable → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="spark.util.TimeStampedHashSet#size" data-isabs="false"> + <a id="size():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">size</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.TimeStampedHashSet" class="extype" href="">TimeStampedHashSet</a> → GenTraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.Builder#sizeHint" data-isabs="false"> + <a id="sizeHint(scala.collection.TraversableLike[_, _],Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sizeHint</span><span class="params">(<span name="coll">coll: scala.collection.TraversableLike[_, _]</span>, <span name="delta">delta: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Builder</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.Builder#sizeHint" data-isabs="false"> + <a id="sizeHint(Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sizeHint</span><span class="params">(<span name="size">size: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Builder</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.Builder#sizeHintBounded" data-isabs="false"> + <a id="sizeHintBounded(Int,scala.collection.TraversableLike[_, _]):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sizeHintBounded</span><span class="params">(<span name="size">size: <span name="scala.Int" class="extype">Int</span></span>, <span name="boundingColl">boundingColl: scala.collection.TraversableLike[_, _]</span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Builder</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#slice" data-isabs="false"> + <a id="slice(Int,Int):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">slice</span><span class="params">(<span name="from">from: <span name="scala.Int" class="extype">Int</span></span>, <span name="until">until: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#sliding" data-isabs="false"> + <a id="sliding[B>:A](Int,Int):Iterator[Set[A]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sliding</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span name="size">size: <span name="scala.Int" class="extype">Int</span></span>, <span name="step">step: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#sliding" data-isabs="false"> + <a id="sliding[B>:A](Int):Iterator[Set[A]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sliding</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span name="size">size: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#span" data-isabs="false"> + <a id="span((A) ⇒ Boolean):(Set[A], Set[A])"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">span</span><span class="params">(<span name="p">p: (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: (<span name="scala.collection.mutable.Set" class="extype">Set</span>[A], <span name="scala.collection.mutable.Set" class="extype">Set</span>[A])</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#splitAt" data-isabs="false"> + <a id="splitAt(Int):(Set[A], Set[A])"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">splitAt</span><span class="params">(<span name="n">n: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: (<span name="scala.collection.mutable.Set" class="extype">Set</span>[A], <span name="scala.collection.mutable.Set" class="extype">Set</span>[A])</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.SetLike#stringPrefix" data-isabs="false"> + <a id="stringPrefix:String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">stringPrefix</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.GenSetLike#subsetOf" data-isabs="false"> + <a id="subsetOf(GenSet[A]):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subsetOf</span><span class="params">(<span name="that">that: <span name="scala.collection.GenSet" class="extype">GenSet</span>[A]</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenSetLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.SetLike#subsets" data-isabs="false"> + <a id="subsets:Iterator[Set[A]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subsets</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.SetLike#subsets" data-isabs="false"> + <a id="subsets(Int):Iterator[Set[A]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subsets</span><span class="params">(<span name="len">len: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#sum" data-isabs="false"> + <a id="sum[B>:A](Numeric[B]):B"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sum</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="num">num: Numeric[B]</span>)</span><span class="result">: B</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#tail" data-isabs="false"> + <a id="tail:Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">tail</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#tails" data-isabs="false"> + <a id="tails:Iterator[Set[A]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">tails</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#take" data-isabs="false"> + <a id="take(Int):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">take</span><span class="params">(<span name="n">n: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#takeRight" data-isabs="false"> + <a id="takeRight(Int):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeRight</span><span class="params">(<span name="n">n: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#takeWhile" data-isabs="false"> + <a id="takeWhile((A) ⇒ Boolean):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">takeWhile</span><span class="params">(<span name="p">p: (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → GenTraversableLike</dd></dl></div> + </li><li visbl="prt" name="scala.collection.IterableLike#thisCollection" data-isabs="false"> + <a id="thisCollection:Iterable[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">thisCollection</span><span class="result">: <span name="scala.collection.Iterable" class="extype">Iterable</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[this] </dd><dt>Definition Classes</dt><dd>IterableLike → TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#toArray" data-isabs="false"> + <a id="toArray[B>:A](ClassManifest[B]):Array[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toArray</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="arg0">arg0: ClassManifest[B]</span>)</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.SetLike#toBuffer" data-isabs="false"> + <a id="toBuffer[A1>:A]:Buffer[A1]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toBuffer</span><span class="tparams">[<span name="A1">A1 >: A</span>]</span><span class="result">: <span name="scala.collection.mutable.Buffer" class="extype">Buffer</span>[A1]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="prt" name="scala.collection.IterableLike#toCollection" data-isabs="false"> + <a id="toCollection(Set[A]):Iterable[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toCollection</span><span class="params">(<span name="repr">repr: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span>)</span><span class="result">: <span name="scala.collection.Iterable" class="extype">Iterable</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[this] </dd><dt>Definition Classes</dt><dd>IterableLike → TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#toIndexedSeq" data-isabs="false"> + <a id="toIndexedSeq[B>:A]:IndexedSeq[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toIndexedSeq</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="result">: <span name="scala.collection.immutable.IndexedSeq" class="extype">IndexedSeq</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#toIterable" data-isabs="false"> + <a id="toIterable:Iterable[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toIterable</span><span class="result">: <span name="scala.collection.Iterable" class="extype">Iterable</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#toIterator" data-isabs="false"> + <a id="toIterator:Iterator[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toIterator</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#toList" data-isabs="false"> + <a id="toList:List[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toList</span><span class="result">: List[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#toMap" data-isabs="false"> + <a id="toMap[T, U](<:<[A, (T, U)]):Map[T, U]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toMap</span><span class="tparams">[<span name="T">T</span>, <span name="U">U</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="ev">ev: <span name="scala.Predef.<:<" class="extype"><:<</span>[A, (T, U)]</span>)</span><span class="result">: <span name="scala.collection.immutable.Map" class="extype">Map</span>[T, U]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.SetLike#toSeq" data-isabs="false"> + <a id="toSeq:Seq[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toSeq</span><span class="result">: <span name="scala.collection.Seq" class="extype">Seq</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableOnce#toSet" data-isabs="false"> + <a id="toSet[B>:A]:Set[B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toSet</span><span class="tparams">[<span name="B">B >: A</span>]</span><span class="result">: <span name="scala.collection.immutable.Set" class="extype">Set</span>[B]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#toStream" data-isabs="false"> + <a id="toStream:Stream[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toStream</span><span class="result">: <span name="scala.collection.immutable.Stream" class="extype">Stream</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.SetLike#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → Function1 → TraversableLike → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#toTraversable" data-isabs="false"> + <a id="toTraversable:Traversable[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toTraversable</span><span class="result">: <span name="scala.collection.Traversable" class="extype">Traversable</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → TraversableOnce → GenTraversableOnce</dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.GenericTraversableTemplate#transpose" data-isabs="false"> + <a id="transpose[B]((A) ⇒ GenTraversableOnce[B]):Set[Set[B]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">transpose</span><span class="tparams">[<span name="B">B</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="asTraversable">asTraversable: (A) ⇒ <span name="scala.collection.GenTraversableOnce" class="extype">GenTraversableOnce</span>[B]</span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[B]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenericTraversableTemplate</dd><dt>Annotations</dt><dd> + <span class="name">@migration</span> + + </dd><dt>Migration</dt><dd class="cmt"><p><i>(Changed in version 2.9.0)</i> <code>transpose</code> throws an <code>IllegalArgumentException</code> if collections are not uniformly sized.</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.SetLike#union" data-isabs="false"> + <a id="union(GenSet[A]):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">union</span><span class="params">(<span name="that">that: <span name="scala.collection.GenSet" class="extype">GenSet</span>[A]</span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike → GenSetLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.GenericTraversableTemplate#unzip" data-isabs="false"> + <a id="unzip[A1, A2]((A) ⇒ (A1, A2)):(Set[A1], Set[A2])"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">unzip</span><span class="tparams">[<span name="A1">A1</span>, <span name="A2">A2</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="asPair">asPair: (A) ⇒ (A1, A2)</span>)</span><span class="result">: (<span name="scala.collection.mutable.Set" class="extype">Set</span>[A1], <span name="scala.collection.mutable.Set" class="extype">Set</span>[A2])</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenericTraversableTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.collection.generic.GenericTraversableTemplate#unzip3" data-isabs="false"> + <a id="unzip3[A1, A2, A3]((A) ⇒ (A1, A2, A3)):(Set[A1], Set[A2], Set[A3])"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">unzip3</span><span class="tparams">[<span name="A1">A1</span>, <span name="A2">A2</span>, <span name="A3">A3</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="asTriple">asTriple: (A) ⇒ (A1, A2, A3)</span>)</span><span class="result">: (<span name="scala.collection.mutable.Set" class="extype">Set</span>[A1], <span name="scala.collection.mutable.Set" class="extype">Set</span>[A2], <span name="scala.collection.mutable.Set" class="extype">Set</span>[A3])</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenericTraversableTemplate</dd></dl></div> + </li><li visbl="pub" name="scala.collection.mutable.SetLike#update" data-isabs="false"> + <a id="update(A,Boolean):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">update</span><span class="params">(<span name="elem">elem: A</span>, <span name="included">included: <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#view" data-isabs="false"> + <a id="view(Int,Int):IterableView[A, Set[A]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">view</span><span class="params">(<span name="from">from: <span name="scala.Int" class="extype">Int</span></span>, <span name="until">until: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.collection.IterableView" class="extype">IterableView</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#view" data-isabs="false"> + <a id="view:IterableView[A, Set[A]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">view</span><span class="result">: <span name="scala.collection.IterableView" class="extype">IterableView</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → TraversableLike</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.collection.TraversableLike#withFilter" data-isabs="false"> + <a id="withFilter((A) ⇒ Boolean):FilterMonadic[A, Set[A]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">withFilter</span><span class="params">(<span name="p">p: (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></span>)</span><span class="result">: <span name="scala.collection.generic.FilterMonadic" class="extype">FilterMonadic</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>TraversableLike → FilterMonadic</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#zip" data-isabs="false"> + <a id="zip[A1>:A, B, That](GenIterable[B])(CanBuildFrom[Set[A], (A1, B), That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zip</span><span class="tparams">[<span name="A1">A1 >: A</span>, <span name="B">B</span>, <span name="That">That</span>]</span><span class="params">(<span name="that">that: <span name="scala.collection.GenIterable" class="extype">GenIterable</span>[B]</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A], (A1, B), That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → GenIterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#zipAll" data-isabs="false"> + <a id="zipAll[B, A1>:A, That](GenIterable[B],A1,B)(CanBuildFrom[Set[A], (A1, B), That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zipAll</span><span class="tparams">[<span name="B">B</span>, <span name="A1">A1 >: A</span>, <span name="That">That</span>]</span><span class="params">(<span name="that">that: <span name="scala.collection.GenIterable" class="extype">GenIterable</span>[B]</span>, <span name="thisElem">thisElem: A1</span>, <span name="thatElem">thatElem: B</span>)</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A], (A1, B), That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → GenIterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#zipWithIndex" data-isabs="false"> + <a id="zipWithIndex[A1>:A, That](CanBuildFrom[Set[A], (A1, Int), That]):That"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zipWithIndex</span><span class="tparams">[<span name="A1">A1 >: A</span>, <span name="That">That</span>]</span><span class="params">(<span class="implicit">implicit </span><span name="bf">bf: <span name="scala.collection.generic.CanBuildFrom" class="extype">CanBuildFrom</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A], (A1, <span name="scala.Int" class="extype">Int</span>), That]</span>)</span><span class="result">: That</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike → GenIterableLike</dd></dl></div> + </li><li visbl="pub" name="scala.collection.GenSetLike#|" data-isabs="false"> + <a id="|(GenSet[A]):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bar">|</span><span class="params">(<span name="that">that: <span name="scala.collection.GenSet" class="extype">GenSet</span>[A]</span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>GenSetLike</dd></dl></div> + </li></ol> + </div> + + <div class="values members" id="values"> + <h3>Deprecated Value Members</h3> + <ol><li visbl="pub" name="scala.collection.SetLike#**" data-isabs="false"> + <a id="**(Set[A]):Set[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="gt4s: $times$times. Deprecated: (Since version 2.8.0) use &amp; instead">**</span><span class="params">(<span name="that">that: <span name="scala.collection.Set" class="extype">Set</span>[A]</span>)</span><span class="result">: <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>SetLike</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use & instead</p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#elements" data-isabs="false"> + <a id="elements:Iterator[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use iterator' instead">elements</span><span class="result">: <span name="scala.collection.Iterator" class="extype">Iterator</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use <code>iterator' instead</code></p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#first" data-isabs="false"> + <a id="first:A"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use head' instead">first</span><span class="result">: A</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use <code>head' instead</code></p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#firstOption" data-isabs="false"> + <a id="firstOption:Option[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use headOption' instead">firstOption</span><span class="result">: <span name="scala.Option" class="extype">Option</span>[A]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use <code>headOption' instead</code></p></dd></dl></div> + </li><li visbl="pub" name="scala.collection.IterableLike#projection" data-isabs="false"> + <a id="projection:IterableView[A, Set[A]]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name deprecated" title="Deprecated: (Since version 2.8.0) use view' instead">projection</span><span class="result">: <span name="scala.collection.IterableView" class="extype">IterableView</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>IterableLike</dd><dt>Annotations</dt><dd> + <span class="name">@deprecated</span> + + </dd><dt>Deprecated</dt><dd class="cmt"><p><i>(Since version 2.8.0)</i> use <code>view' instead</code></p></dd></dl></div> + </li></ol> + </div> + </div> + + <div id="inheritedMembers"> + <div name="scala.collection.mutable.Set" class="parent"> + <h3>Inherited from <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]</h3> + </div><div name="scala.collection.mutable.SetLike" class="parent"> + <h3>Inherited from <span name="scala.collection.mutable.SetLike" class="extype">SetLike</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</h3> + </div><div name="scala.collection.mutable.Cloneable" class="parent"> + <h3>Inherited from <span name="scala.collection.mutable.Cloneable" class="extype">Cloneable</span>[<span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</h3> + </div><div name="scala.collection.generic.Shrinkable" class="parent"> + <h3>Inherited from <span name="scala.collection.generic.Shrinkable" class="extype">Shrinkable</span>[A]</h3> + </div><div name="scala.collection.mutable.Builder" class="parent"> + <h3>Inherited from <span name="scala.collection.mutable.Builder" class="extype">Builder</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</h3> + </div><div name="scala.collection.generic.Growable" class="parent"> + <h3>Inherited from <span name="scala.collection.generic.Growable" class="extype">Growable</span>[A]</h3> + </div><div name="scala.collection.script.Scriptable" class="parent"> + <h3>Inherited from <span name="scala.collection.script.Scriptable" class="extype">Scriptable</span>[A]</h3> + </div><div name="scala.collection.Set" class="parent"> + <h3>Inherited from <span name="scala.collection.Set" class="extype">Set</span>[A]</h3> + </div><div name="scala.collection.SetLike" class="parent"> + <h3>Inherited from <span name="scala.collection.SetLike" class="extype">SetLike</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</h3> + </div><div name="scala.collection.generic.Subtractable" class="parent"> + <h3>Inherited from <span name="scala.collection.generic.Subtractable" class="extype">Subtractable</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</h3> + </div><div name="scala.collection.GenSet" class="parent"> + <h3>Inherited from <span name="scala.collection.GenSet" class="extype">GenSet</span>[A]</h3> + </div><div name="scala.collection.generic.GenericSetTemplate" class="parent"> + <h3>Inherited from <span name="scala.collection.generic.GenericSetTemplate" class="extype">GenericSetTemplate</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>]</h3> + </div><div name="scala.collection.GenSetLike" class="parent"> + <h3>Inherited from <span name="scala.collection.GenSetLike" class="extype">GenSetLike</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</h3> + </div><div name="scala.Function1" class="parent"> + <h3>Inherited from (A) ⇒ <span name="scala.Boolean" class="extype">Boolean</span></h3> + </div><div name="scala.collection.mutable.Iterable" class="parent"> + <h3>Inherited from <span name="scala.collection.mutable.Iterable" class="extype">Iterable</span>[A]</h3> + </div><div name="scala.collection.Iterable" class="parent"> + <h3>Inherited from <span name="scala.collection.Iterable" class="extype">Iterable</span>[A]</h3> + </div><div name="scala.collection.IterableLike" class="parent"> + <h3>Inherited from <span name="scala.collection.IterableLike" class="extype">IterableLike</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</h3> + </div><div name="scala.Equals" class="parent"> + <h3>Inherited from <span name="scala.Equals" class="extype">Equals</span></h3> + </div><div name="scala.collection.GenIterable" class="parent"> + <h3>Inherited from <span name="scala.collection.GenIterable" class="extype">GenIterable</span>[A]</h3> + </div><div name="scala.collection.GenIterableLike" class="parent"> + <h3>Inherited from <span name="scala.collection.GenIterableLike" class="extype">GenIterableLike</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</h3> + </div><div name="scala.collection.mutable.Traversable" class="parent"> + <h3>Inherited from <span name="scala.collection.mutable.Traversable" class="extype">Traversable</span>[A]</h3> + </div><div name="scala.Mutable" class="parent"> + <h3>Inherited from <span name="scala.Mutable" class="extype">Mutable</span></h3> + </div><div name="scala.collection.Traversable" class="parent"> + <h3>Inherited from <span name="scala.collection.Traversable" class="extype">Traversable</span>[A]</h3> + </div><div name="scala.collection.GenTraversable" class="parent"> + <h3>Inherited from <span name="scala.collection.GenTraversable" class="extype">GenTraversable</span>[A]</h3> + </div><div name="scala.collection.generic.GenericTraversableTemplate" class="parent"> + <h3>Inherited from <span name="scala.collection.generic.GenericTraversableTemplate" class="extype">GenericTraversableTemplate</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>]</h3> + </div><div name="scala.collection.TraversableLike" class="parent"> + <h3>Inherited from <span name="scala.collection.TraversableLike" class="extype">TraversableLike</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</h3> + </div><div name="scala.collection.GenTraversableLike" class="parent"> + <h3>Inherited from <span name="scala.collection.GenTraversableLike" class="extype">GenTraversableLike</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</h3> + </div><div name="scala.collection.Parallelizable" class="parent"> + <h3>Inherited from <span name="scala.collection.Parallelizable" class="extype">Parallelizable</span>[A, <span name="scala.collection.parallel.mutable.ParSet" class="extype">ParSet</span>[A]]</h3> + </div><div name="scala.collection.TraversableOnce" class="parent"> + <h3>Inherited from <span name="scala.collection.TraversableOnce" class="extype">TraversableOnce</span>[A]</h3> + </div><div name="scala.collection.GenTraversableOnce" class="parent"> + <h3>Inherited from <span name="scala.collection.GenTraversableOnce" class="extype">GenTraversableOnce</span>[A]</h3> + </div><div name="scala.collection.generic.FilterMonadic" class="parent"> + <h3>Inherited from <span name="scala.collection.generic.FilterMonadic" class="extype">FilterMonadic</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</h3> + </div><div name="scala.collection.generic.HasNewBuilder" class="parent"> + <h3>Inherited from <span name="scala.collection.generic.HasNewBuilder" class="extype">HasNewBuilder</span>[A, <span name="scala.collection.mutable.Set" class="extype">Set</span>[A]]</h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/util/Vector$$Multiplier.html b/site/docs/0.7.0/api/core/spark/util/Vector$$Multiplier.html new file mode 100644 index 000000000..fc1fcc022 --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/util/Vector$$Multiplier.html @@ -0,0 +1,382 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.util.Vector.Multiplier</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <img src="../../lib/class_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.util" class="extype" href="package.html">util</a>.<a name="spark.util.Vector" class="extype" href="Vector$.html">Vector</a></p> + <h1>Multiplier</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">Multiplier</span><span class="result"> extends AnyRef</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent">AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.util.Vector.Multiplier" class="in"><span>Multiplier</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.util.Vector.Multiplier#this" data-isabs="false"> + <a id="this:Multiplier"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">Multiplier</span><span class="params">(<span name="num">num: <span name="scala.Double" class="extype">Double</span></span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.util.Vector.Multiplier#*" data-isabs="false"> + <a id="*(Vector):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $times">*</span><span class="params">(<span name="vec">vec: <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/util/Vector$$VectorAccumParam$.html b/site/docs/0.7.0/api/core/spark/util/Vector$$VectorAccumParam$.html new file mode 100644 index 000000000..49a2df85f --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/util/Vector$$VectorAccumParam$.html @@ -0,0 +1,417 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.util.Vector.VectorAccumParam</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../lib/object_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.util" class="extype" href="package.html">util</a>.<a name="spark.util.Vector" class="extype" href="Vector$.html">Vector</a></p> + <h1>VectorAccumParam</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">VectorAccumParam</span><span class="result"> extends <a name="spark.AccumulatorParam" class="extype" href="../AccumulatorParam.html">AccumulatorParam</a>[<a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a>]</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><a name="spark.AccumulatorParam" class="extype" href="../AccumulatorParam.html">AccumulatorParam</a>[<a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a>], <a name="spark.AccumulableParam" class="extype" href="../AccumulableParam.html">AccumulableParam</a>[<a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a>, <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a>], <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.util.Vector.VectorAccumParam" class="in"><span>VectorAccumParam</span></li><li name="spark.AccumulatorParam" class="in"><span>AccumulatorParam</span></li><li name="spark.AccumulableParam" class="in"><span>AccumulableParam</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.AccumulatorParam#addAccumulator" data-isabs="false"> + <a id="addAccumulator(Vector,Vector):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addAccumulator</span><span class="params">(<span name="t1">t1: <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a></span>, <span name="t2">t2: <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a></span> + </span> + </h4> + <p class="shortcomment cmt">Add additional data to the accumulator value.</p><div class="fullcomment"><div class="comment cmt"><p>Add additional data to the accumulator value. Is allowed to modify and return <code>r</code> +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt>returns</dt><dd class="cmt"><p>the new value of the accumulator +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.AccumulatorParam" class="extype" href="../AccumulatorParam.html">AccumulatorParam</a> → <a name="spark.AccumulableParam" class="extype" href="../AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li><li visbl="pub" name="spark.util.Vector.VectorAccumParam#addInPlace" data-isabs="false"> + <a id="addInPlace(Vector,Vector):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addInPlace</span><span class="params">(<span name="t1">t1: <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a></span>, <span name="t2">t2: <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a></span> + </span> + </h4> + <p class="shortcomment cmt">Merge two accumulated values together.</p><div class="fullcomment"><div class="comment cmt"><p>Merge two accumulated values together. Is allowed to modify and return the first value +for efficiency (to avoid allocating objects). +</p></div><dl class="paramcmts block"><dt>returns</dt><dd class="cmt"><p>both data sets merged together +</p></dd></dl><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.Vector.VectorAccumParam" class="extype" href="">VectorAccumParam</a> → <a name="spark.AccumulableParam" class="extype" href="../AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="prt" name="spark.util.Vector.VectorAccumParam#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.util.Vector.VectorAccumParam#zero" data-isabs="false"> + <a id="zero(Vector):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zero</span><span class="params">(<span name="initialValue">initialValue: <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a></span> + </span> + </h4> + <p class="shortcomment cmt">Return the "zero" (identity) value for an accumulator type, given its initial value.</p><div class="fullcomment"><div class="comment cmt"><p>Return the "zero" (identity) value for an accumulator type, given its initial value. For +example, if R was a vector of N dimensions, this would return a vector of N zeroes. +</p></div><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.Vector.VectorAccumParam" class="extype" href="">VectorAccumParam</a> → <a name="spark.AccumulableParam" class="extype" href="../AccumulableParam.html">AccumulableParam</a></dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="spark.AccumulatorParam" class="parent"> + <h3>Inherited from <a name="spark.AccumulatorParam" class="extype" href="../AccumulatorParam.html">AccumulatorParam</a>[<a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a>]</h3> + </div><div name="spark.AccumulableParam" class="parent"> + <h3>Inherited from <a name="spark.AccumulableParam" class="extype" href="../AccumulableParam.html">AccumulableParam</a>[<a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a>, <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a>]</h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/util/Vector$.html b/site/docs/0.7.0/api/core/spark/util/Vector$.html new file mode 100644 index 000000000..0193dd97f --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/util/Vector$.html @@ -0,0 +1,470 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.util.Vector</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <a title="Go to companion" href="Vector.html"><img src="../../lib/object_to_class_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.util" class="extype" href="package.html">util</a></p> + <h1><a title="Go to companion" href="Vector.html">Vector</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <span class="name">Vector</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.util.Vector" class="in"><span>Vector</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + <div class="types members" id="types"> + <h3>Type Members</h3> + <ol><li visbl="pub" name="spark.util.Vector.Multiplier" data-isabs="false"> + <a id="Multiplier:Multiplier"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="Vector$$Multiplier.html"><span class="name">Multiplier</span></a><span class="result"> extends AnyRef</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.util.Vector.VectorAccumParam" data-isabs="false"> + <a id="VectorAccumParam:VectorAccumParam"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="Vector$$VectorAccumParam$.html"><span class="name">VectorAccumParam</span></a><span class="result"> extends AccumulatorParam[Vector]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector#apply" data-isabs="false"> + <a id="apply(Int,(Int) ⇒ Double):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="length">length: <span name="scala.Int" class="extype">Int</span></span>, <span name="initializer">initializer: (<span name="scala.Int" class="extype">Int</span>) ⇒ <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector#apply" data-isabs="false"> + <a id="apply(Double*):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="elements">elements: <span name="scala.Double" class="extype">Double</span>*</span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector#apply" data-isabs="false"> + <a id="apply(Array[Double]):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="elements">elements: <span name="scala.Array" class="extype">Array</span>[<span name="scala.Double" class="extype">Double</span>]</span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.util.Vector#doubleToMultiplier" data-isabs="false"> + <a id="doubleToMultiplier(Double):Multiplier"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">implicit </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">doubleToMultiplier</span><span class="params">(<span name="num">num: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.util.Vector.Multiplier" class="extype" href="Vector$$Multiplier.html">Multiplier</a></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.util.Vector#ones" data-isabs="false"> + <a id="ones(Int):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ones</span><span class="params">(<span name="length">length: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a></span> + </span> + </h4> + + </li><li visbl="prt" name="spark.util.Vector#readResolve" data-isabs="false"> + <a id="readResolve():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">readResolve</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: <span name="java.lang.String" class="extype">String</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.util.Vector#zeros" data-isabs="false"> + <a id="zeros(Int):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">zeros</span><span class="params">(<span name="length">length: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="Vector.html">Vector</a></span> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/util/Vector.html b/site/docs/0.7.0/api/core/spark/util/Vector.html new file mode 100644 index 000000000..488a5d8ca --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/util/Vector.html @@ -0,0 +1,604 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.util.Vector</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="type"> + <div id="definition"> + <a title="Go to companion" href="Vector$.html"><img src="../../lib/class_to_object_big.png" /></a> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a>.<a name="spark.util" class="extype" href="package.html">util</a></p> + <h1><a title="Go to companion" href="Vector$.html">Vector</a></h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <span class="name">Vector</span><span class="result"> extends <span name="scala.Serializable" class="extype">Serializable</span></span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"><div class="toggleContainer block"> + <span class="toggle">Linear Supertypes</span> + <div class="superTypes hiddenContent"><span name="scala.Serializable" class="extype">Serializable</span>, <span name="java.io.Serializable" class="extype">Serializable</span>, AnyRef, <span name="scala.Any" class="extype">Any</span></div> + </div></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + <div id="order"> + <span class="filtertype">Ordering</span> + <ol><li class="alpha in"><span>Alphabetic</span></li><li class="inherit out"><span>By inheritance</span></li></ol> + </div> + <div id="ancestors"> + <span class="filtertype">Inherited</span> + <ol><li class="hideall out"><span>Hide All</span></li> + <li class="showall in"><span>Show all</span></li></ol> + <ol id="linearization"><li name="spark.util.Vector" class="in"><span>Vector</span></li><li name="scala.Serializable" class="in"><span>Serializable</span></li><li name="java.io.Serializable" class="in"><span>Serializable</span></li><li name="scala.AnyRef" class="in"><span>AnyRef</span></li><li name="scala.Any" class="in"><span>Any</span></li></ol> + </div> + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + <div class="members" id="constructors"> + <h3>Instance Constructors</h3> + <ol><li visbl="pub" name="spark.util.Vector#this" data-isabs="false"> + <a id="this:Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">new</span> + </span> + <span class="symbol"> + <span class="name">Vector</span><span class="params">(<span name="elements">elements: <span name="scala.Array" class="extype">Array</span>[<span name="scala.Double" class="extype">Double</span>]</span>)</span> + </span> + </h4> + + </li></ol> + </div> + + + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="scala.AnyRef#!=" data-isabs="false"> + <a id="!=(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#!=" data-isabs="false"> + <a id="!=(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $bang$eq">!=</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef###" data-isabs="false"> + <a id="##():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $hash$hash">##</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.util.Vector#*" data-isabs="false"> + <a id="*(Double):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $times">*</span><span class="params">(<span name="scale">scale: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="">Vector</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector#+" data-isabs="false"> + <a id="+(Vector):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus">+</span><span class="params">(<span name="other">other: <a name="spark.util.Vector" class="extype" href="">Vector</a></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="">Vector</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector#+=" data-isabs="false"> + <a id="+=(Vector):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $plus$eq">+=</span><span class="params">(<span name="other">other: <a name="spark.util.Vector" class="extype" href="">Vector</a></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="">Vector</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector#-" data-isabs="false"> + <a id="-(Vector):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $minus">-</span><span class="params">(<span name="other">other: <a name="spark.util.Vector" class="extype" href="">Vector</a></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="">Vector</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector#/" data-isabs="false"> + <a id="/(Double):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $div">/</span><span class="params">(<span name="d">d: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="">Vector</a></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#==" data-isabs="false"> + <a id="==(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.Any#==" data-isabs="false"> + <a id="==(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: $eq$eq">==</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.util.Vector#add" data-isabs="false"> + <a id="add(Vector):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">add</span><span class="params">(<span name="other">other: <a name="spark.util.Vector" class="extype" href="">Vector</a></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="">Vector</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector#addInPlace" data-isabs="false"> + <a id="addInPlace(Vector):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">addInPlace</span><span class="params">(<span name="other">other: <a name="spark.util.Vector" class="extype" href="">Vector</a></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="">Vector</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector#apply" data-isabs="false"> + <a id="apply(Int):Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">apply</span><span class="params">(<span name="index">index: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.Any#asInstanceOf" data-isabs="false"> + <a id="asInstanceOf[T0]:T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">asInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#clone" data-isabs="false"> + <a id="clone():AnyRef"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">clone</span><span class="params">()</span><span class="result">: AnyRef</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="spark.util.Vector#dist" data-isabs="false"> + <a id="dist(Vector):Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dist</span><span class="params">(<span name="other">other: <a name="spark.util.Vector" class="extype" href="">Vector</a></span>)</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector#divide" data-isabs="false"> + <a id="divide(Double):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">divide</span><span class="params">(<span name="d">d: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="">Vector</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector#dot" data-isabs="false"> + <a id="dot(Vector):Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">dot</span><span class="params">(<span name="other">other: <a name="spark.util.Vector" class="extype" href="">Vector</a></span>)</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector#elements" data-isabs="false"> + <a id="elements:Array[Double]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">val</span> + </span> + <span class="symbol"> + <span class="name">elements</span><span class="result">: <span name="scala.Array" class="extype">Array</span>[<span name="scala.Double" class="extype">Double</span>]</span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#eq" data-isabs="false"> + <a id="eq(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">eq</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#equals" data-isabs="false"> + <a id="equals(Any):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">equals</span><span class="params">(<span name="arg0">arg0: <span name="scala.Any" class="extype">Any</span></span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="prt" name="scala.AnyRef#finalize" data-isabs="false"> + <a id="finalize():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">finalize</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Attributes</dt><dd>protected[<a name="java.lang" class="extype" href="../../java/lang/package.html">lang</a>] </dd><dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#getClass" data-isabs="false"> + <a id="getClass():java.lang.Class[_]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">getClass</span><span class="params">()</span><span class="result">: java.lang.Class[_]</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#hashCode" data-isabs="false"> + <a id="hashCode():Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">hashCode</span><span class="params">()</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="scala.Any#isInstanceOf" data-isabs="false"> + <a id="isInstanceOf[T0]:Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">isInstanceOf</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>Any</dd></dl></div> + </li><li visbl="pub" name="spark.util.Vector#length" data-isabs="false"> + <a id="length:Int"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">length</span><span class="result">: <span name="scala.Int" class="extype">Int</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector#multiply" data-isabs="false"> + <a id="multiply(Double):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">multiply</span><span class="params">(<span name="d">d: <span name="scala.Double" class="extype">Double</span></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="">Vector</a></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#ne" data-isabs="false"> + <a id="ne(AnyRef):Boolean"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">ne</span><span class="params">(<span name="arg0">arg0: AnyRef</span>)</span><span class="result">: <span name="scala.Boolean" class="extype">Boolean</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notify" data-isabs="false"> + <a id="notify():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notify</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#notifyAll" data-isabs="false"> + <a id="notifyAll():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">notifyAll</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.util.Vector#plusDot" data-isabs="false"> + <a id="plusDot(Vector,Vector):Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">plusDot</span><span class="params">(<span name="plus">plus: <a name="spark.util.Vector" class="extype" href="">Vector</a></span>, <span name="other">other: <a name="spark.util.Vector" class="extype" href="">Vector</a></span>)</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + <p class="shortcomment cmt">return (this + plus) dot other, but without creating any intermediate storage</p><div class="fullcomment"><div class="comment cmt"><p>return (this + plus) dot other, but without creating any intermediate storage</p></div><dl class="paramcmts block"><dt class="param">plus</dt><dd class="cmt"></dd><dt class="param">other</dt><dd class="cmt"><p> +@return +</p></dd></dl></div> + </li><li visbl="pub" name="spark.util.Vector#squaredDist" data-isabs="false"> + <a id="squaredDist(Vector):Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">squaredDist</span><span class="params">(<span name="other">other: <a name="spark.util.Vector" class="extype" href="">Vector</a></span>)</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector#subtract" data-isabs="false"> + <a id="subtract(Vector):Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">subtract</span><span class="params">(<span name="other">other: <a name="spark.util.Vector" class="extype" href="">Vector</a></span>)</span><span class="result">: <a name="spark.util.Vector" class="extype" href="">Vector</a></span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector#sum" data-isabs="false"> + <a id="sum:Double"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">sum</span><span class="result">: <span name="scala.Double" class="extype">Double</span></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#synchronized" data-isabs="false"> + <a id="synchronized[T0](⇒ T0):T0"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">synchronized</span><span class="tparams">[<span name="T0">T0</span>]</span><span class="params">(<span name="arg0">arg0: ⇒ T0</span>)</span><span class="result">: T0</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd></dl></div> + </li><li visbl="pub" name="spark.util.Vector#toString" data-isabs="false"> + <a id="toString():String"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">toString</span><span class="params">()</span><span class="result">: String</span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd><a name="spark.util.Vector" class="extype" href="">Vector</a> → AnyRef → Any</dd></dl></div> + </li><li visbl="pub" name="spark.util.Vector#unary_-" data-isabs="false"> + <a id="unary_-:Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name" title="gt4s: unary_$minus">unary_-</span><span class="result">: <a name="spark.util.Vector" class="extype" href="">Vector</a></span> + </span> + </h4> + + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait():Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">()</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long,Int):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>, <span name="arg1">arg1: <span name="scala.Int" class="extype">Int</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li><li visbl="pub" name="scala.AnyRef#wait" data-isabs="false"> + <a id="wait(Long):Unit"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier">final </span> + <span class="kind">def</span> + </span> + <span class="symbol"> + <span class="name">wait</span><span class="params">(<span name="arg0">arg0: <span name="scala.Long" class="extype">Long</span></span>)</span><span class="result">: <span name="scala.Unit" class="extype">Unit</span></span> + </span> + </h4> + <div class="fullcomment"><dl class="attributes block"> <dt>Definition Classes</dt><dd>AnyRef</dd><dt>Annotations</dt><dd> + <span class="name">@throws</span><span class="args">()</span> + + </dd></dl></div> + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + <div name="scala.Serializable" class="parent"> + <h3>Inherited from <span name="scala.Serializable" class="extype">Serializable</span></h3> + </div><div name="java.io.Serializable" class="parent"> + <h3>Inherited from <span name="java.io.Serializable" class="extype">Serializable</span></h3> + </div><div name="scala.AnyRef" class="parent"> + <h3>Inherited from AnyRef</h3> + </div><div name="scala.Any" class="parent"> + <h3>Inherited from <span name="scala.Any" class="extype">Any</span></h3> + </div> + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file diff --git a/site/docs/0.7.0/api/core/spark/util/package.html b/site/docs/0.7.0/api/core/spark/util/package.html new file mode 100644 index 000000000..66c3deb2c --- /dev/null +++ b/site/docs/0.7.0/api/core/spark/util/package.html @@ -0,0 +1,185 @@ +<?xml version='1.0' encoding='UTF-8'?> +<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"> +<html> + <head> + <title>spark.util</title> + <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> + + <link type="text/css" media="screen" rel="stylesheet" href="../../lib/template.css" /> + <script type="text/javascript" src="../../lib/jquery.js"></script> + <script type="text/javascript" src="../../lib/jquery-ui.js"></script> + <script type="text/javascript" src="../../lib/template.js"></script> + <script type="text/javascript" src="../../lib/tools.tooltip.js"></script> + + </head> + <body onload="sh_highlightDocument('../lib/', '.min.js');" class="value"> + <div id="definition"> + <img src="../../lib/package_big.png" /> + <p id="owner"><a name="spark" class="extype" href="../package.html">spark</a></p> + <h1>util</h1> + </div> + + <h4 class="signature" id="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">package</span> + </span> + <span class="symbol"> + <span class="name">util</span> + </span> + </h4> + + <div class="fullcommenttop" id="comment"></div> + + + <div id="mbrsel"> + <div id="textfilter"><span class="pre"></span><span class="input"><input accesskey="/" type="text" /></span><span class="post"></span></div> + + + <div id="visbl"> + <span class="filtertype">Visibility</span> + <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> + </div> + </div> + + <div id="template"> + <div id="allMembers"> + + + <div class="types members" id="types"> + <h3>Type Members</h3> + <ol><li visbl="pub" name="spark.util.MetadataCleaner" data-isabs="false"> + <a id="MetadataCleaner:MetadataCleaner"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="MetadataCleaner.html"><span class="name">MetadataCleaner</span></a><span class="result"> extends Logging</span> + </span> + </h4> + <p class="comment cmt">Runs a timer task to periodically clean up metadata (e.</p> + </li><li visbl="pub" name="spark.util.RateLimitedOutputStream" data-isabs="false"> + <a id="RateLimitedOutputStream:RateLimitedOutputStream"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="RateLimitedOutputStream.html"><span class="name">RateLimitedOutputStream</span></a><span class="result"> extends OutputStream</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.StatCounter" data-isabs="false"> + <a id="StatCounter:StatCounter"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="StatCounter.html"><span class="name">StatCounter</span></a><span class="result"> extends Serializable</span> + </span> + </h4> + <p class="comment cmt">A class for tracking the statistics of a set of numbers (count, mean and variance) in a +numerically robust way.</p> + </li><li visbl="pub" name="spark.util.TimeStampedHashMap" data-isabs="false"> + <a id="TimeStampedHashMap:TimeStampedHashMap[A, B]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="TimeStampedHashMap.html"><span class="name">TimeStampedHashMap</span></a><span class="tparams">[<span name="A">A</span>, <span name="B">B</span>]</span><span class="result"> extends Map[A, B] with Logging</span> + </span> + </h4> + <p class="comment cmt">This is a custom implementation of scala.</p> + </li><li visbl="pub" name="spark.util.TimeStampedHashSet" data-isabs="false"> + <a id="TimeStampedHashSet:TimeStampedHashSet[A]"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="TimeStampedHashSet.html"><span class="name">TimeStampedHashSet</span></a><span class="tparams">[<span name="A">A</span>]</span><span class="result"> extends Set[A]</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector" data-isabs="false"> + <a id="Vector:Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">class</span> + </span> + <span class="symbol"> + <a href="Vector.html"><span class="name">Vector</span></a><span class="result"> extends Serializable</span> + </span> + </h4> + + </li></ol> + </div> + + + + <div class="values members" id="values"> + <h3>Value Members</h3> + <ol><li visbl="pub" name="spark.util.MetadataCleaner" data-isabs="false"> + <a id="MetadataCleaner:MetadataCleaner"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="MetadataCleaner$.html"><span class="name">MetadataCleaner</span></a><span class="result"> extends AnyRef</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.StatCounter" data-isabs="false"> + <a id="StatCounter:StatCounter"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="StatCounter$.html"><span class="name">StatCounter</span></a><span class="result"> extends Serializable</span> + </span> + </h4> + + </li><li visbl="pub" name="spark.util.Vector" data-isabs="false"> + <a id="Vector:Vector"></a> + <h4 class="signature"> + <span class="modifier_kind"> + <span class="modifier"></span> + <span class="kind">object</span> + </span> + <span class="symbol"> + <a href="Vector$.html"><span class="name">Vector</span></a><span class="result"> extends Serializable</span> + </span> + </h4> + + </li></ol> + </div> + + + </div> + + <div id="inheritedMembers"> + + </div> + + </div> + + <div id="tooltip"></div> + + <div id="footer"> </div> + + + </body> + </html>
\ No newline at end of file |