diff options
| author | Jacek Laskowski <jacek@japila.pl> | 2017-03-30 16:07:27 +0100 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2017-03-30 16:07:27 +0100 |
| commit | 0197262a358fd174a188f8246ae777e53157610e (patch) | |
| tree | 0d0b52965bc6ea18785e97ada5eaca4f29e90b68 /core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala | |
| parent | b454d4402e5ee7d1a7385d1fe3737581f84d2c72 (diff) | |
| download | spark-0197262a358fd174a188f8246ae777e53157610e.tar.gz spark-0197262a358fd174a188f8246ae777e53157610e.tar.bz2 spark-0197262a358fd174a188f8246ae777e53157610e.zip | |
[DOCS] Docs-only improvements
…adoc
## What changes were proposed in this pull request?
Use recommended values for row boundaries in Window's scaladoc, i.e. `Window.unboundedPreceding`, `Window.unboundedFollowing`, and `Window.currentRow` (that were introduced in 2.1.0).
## How was this patch tested?
Local build
Author: Jacek Laskowski <jacek@japila.pl>
Closes #17417 from jaceklaskowski/window-expression-scaladoc.
Diffstat (limited to 'core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala')
| -rw-r--r-- | core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala | 3 |
1 files changed, 1 insertions, 2 deletions
diff --git a/core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala b/core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala index 8b2e26cdd9..ba3e0e395e 100644 --- a/core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala +++ b/core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala @@ -95,8 +95,7 @@ private[spark] class BlockStoreShuffleReader[K, C]( // Sort the output if there is a sort ordering defined. dep.keyOrdering match { case Some(keyOrd: Ordering[K]) => - // Create an ExternalSorter to sort the data. Note that if spark.shuffle.spill is disabled, - // the ExternalSorter won't spill to disk. + // Create an ExternalSorter to sort the data. val sorter = new ExternalSorter[K, C, C](context, ordering = Some(keyOrd), serializer = dep.serializer) sorter.insertAll(aggregatedIter) |