diff options
author | Reynold Xin <rxin@databricks.com> | 2016-04-18 19:30:00 -0700 |
---|---|---|
committer | Reynold Xin <rxin@databricks.com> | 2016-04-18 19:30:00 -0700 |
commit | 5e92583d38e11d39deb429a39725443111205a4a (patch) | |
tree | 3ca0408257968f37a7e5e4d0c35ed05f449c145d /sql/core/src | |
parent | 4b3d1294aeecc0001a7fa48c92796e6075d34540 (diff) | |
download | spark-5e92583d38e11d39deb429a39725443111205a4a.tar.gz spark-5e92583d38e11d39deb429a39725443111205a4a.tar.bz2 spark-5e92583d38e11d39deb429a39725443111205a4a.zip |
[SPARK-14667] Remove HashShuffleManager
## What changes were proposed in this pull request?
The sort shuffle manager has been the default since Spark 1.2. It is time to remove the old hash shuffle manager.
## How was this patch tested?
Removed some tests related to the old manager.
Author: Reynold Xin <rxin@databricks.com>
Closes #12423 from rxin/SPARK-14667.
Diffstat (limited to 'sql/core/src')
-rw-r--r-- | sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/ShuffleExchange.scala | 4 |
1 files changed, 0 insertions, 4 deletions
diff --git a/sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/ShuffleExchange.scala b/sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/ShuffleExchange.scala index 7e35db7dd8..d7deac9337 100644 --- a/sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/ShuffleExchange.scala +++ b/sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/ShuffleExchange.scala @@ -22,7 +22,6 @@ import java.util.Random import org.apache.spark._ import org.apache.spark.rdd.RDD import org.apache.spark.serializer.Serializer -import org.apache.spark.shuffle.hash.HashShuffleManager import org.apache.spark.shuffle.sort.SortShuffleManager import org.apache.spark.sql.catalyst.InternalRow import org.apache.spark.sql.catalyst.errors._ @@ -179,9 +178,6 @@ object ShuffleExchange { // copy. true } - } else if (shuffleManager.isInstanceOf[HashShuffleManager]) { - // We're using hash-based shuffle, so we don't need to copy. - false } else { // Catch-all case to safely handle any future ShuffleManager implementations. true |