aboutsummaryrefslogtreecommitdiff
path: root/docs
diff options
context:
space:
mode:
authorReynold Xin <rxin@cs.berkeley.edu>2012-09-29 01:31:36 -0700
committerReynold Xin <rxin@cs.berkeley.edu>2012-09-29 01:31:36 -0700
commitf5812d035473e36e9088f621ff18618d09763f51 (patch)
tree441e5d84d723371a3caad4aca042c828387d0ec9 /docs
parent2f11e3c285499880b9d800fdd65ea9ad1c82b4af (diff)
downloadspark-f5812d035473e36e9088f621ff18618d09763f51.tar.gz
spark-f5812d035473e36e9088f621ff18618d09763f51.tar.bz2
spark-f5812d035473e36e9088f621ff18618d09763f51.zip
Added mapPartitionsWithSplit to the programming guide.
Diffstat (limited to 'docs')
-rw-r--r--docs/scala-programming-guide.md6
1 files changed, 6 insertions, 0 deletions
diff --git a/docs/scala-programming-guide.md b/docs/scala-programming-guide.md
index db761d7df1..983e291543 100644
--- a/docs/scala-programming-guide.md
+++ b/docs/scala-programming-guide.md
@@ -140,6 +140,12 @@ The following tables list the transformations and actions currently supported (s
Iterator[T] => Iterator[U] when running on an RDD of type T. </td>
</tr>
<tr>
+ <td> <b>mapPartitionsWithSplit</b>(<i>func</i>) </td>
+ <td> Similar to mapPartitions, but also provides <i>func</i> with an integer value representing the index of
+ the split, so <i>func</i> must be of type (Int, Iterator[T]) => Iterator[U] when running on an RDD of type T.
+ </td>
+</tr>
+<tr>
<td> <b>sample</b>(<i>withReplacement</i>, <i>fraction</i>, <i>seed</i>) </td>
<td> Sample a fraction <i>fraction</i> of the data, with or without replacement, using a given random number generator seed. </td>
</tr>