diff options
| author | Madhu Siddalingaiah <madhu@madhu.com> | 2014-12-01 08:45:34 -0800 |
|---|---|---|
| committer | Josh Rosen <joshrosen@databricks.com> | 2014-12-01 08:46:01 -0800 |
| commit | 35bc338c04022354654435427bb310acdcb9904a (patch) | |
| tree | 7b157079765b01bd4c178a444effb3bb3db7b8ab /docs | |
| parent | 67a2c138c0932ba15617b05c41ee5a8807244790 (diff) | |
| download | spark-35bc338c04022354654435427bb310acdcb9904a.tar.gz spark-35bc338c04022354654435427bb310acdcb9904a.tar.bz2 spark-35bc338c04022354654435427bb310acdcb9904a.zip | |
Documentation: add description for repartitionAndSortWithinPartitions
Author: Madhu Siddalingaiah <madhu@madhu.com>
Closes #3390 from msiddalingaiah/master and squashes the following commits:
cbccbfe [Madhu Siddalingaiah] Documentation: replace <b> with <code> (again)
332f7a2 [Madhu Siddalingaiah] Documentation: replace <b> with <code>
cd2b05a [Madhu Siddalingaiah] Merge remote-tracking branch 'upstream/master'
0fc12d7 [Madhu Siddalingaiah] Documentation: add description for repartitionAndSortWithinPartitions
(cherry picked from commit 2b233f5fc4beb2c6ed4bc142e923e96f8bad3ec4)
Signed-off-by: Josh Rosen <joshrosen@databricks.com>
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/programming-guide.md | 6 |
1 files changed, 6 insertions, 0 deletions
diff --git a/docs/programming-guide.md b/docs/programming-guide.md index 7a16ee8742..5e0d5c15d7 100644 --- a/docs/programming-guide.md +++ b/docs/programming-guide.md @@ -934,6 +934,12 @@ for details. <td> Reshuffle the data in the RDD randomly to create either more or fewer partitions and balance it across them. This always shuffles all data over the network. </td> </tr> +<tr> + <td> <b>repartitionAndSortWithinPartitions</b>(<i>partitioner</i>) </td> + <td> Repartition the RDD according to the given partitioner and, within each resulting partition, + sort records by their keys. This is more efficient than calling <code>repartition</code> and then sorting within + each partition because it can push the sorting down into the shuffle machinery. </td> +</tr> </table> ### Actions |