diff options
| author | Reynold Xin <rxin@databricks.com> | 2016-12-22 19:35:09 +0100 |
|---|---|---|
| committer | Herman van Hovell <hvanhovell@databricks.com> | 2016-12-22 19:35:09 +0100 |
| commit | 2615100055860faa5f74d3711d4d15ebae6aba25 (patch) | |
| tree | a755b2fec9ec5371dd77c4c6cca4542540eac75b /sql/core | |
| parent | 76622c661fcae81eb0352c61f54a2e9e21a4fb98 (diff) | |
| download | spark-2615100055860faa5f74d3711d4d15ebae6aba25.tar.gz spark-2615100055860faa5f74d3711d4d15ebae6aba25.tar.bz2 spark-2615100055860faa5f74d3711d4d15ebae6aba25.zip | |
[SPARK-18973][SQL] Remove SortPartitions and RedistributeData
## What changes were proposed in this pull request?
SortPartitions and RedistributeData logical operators are not actually used and can be removed. Note that we do have a Sort operator (with global flag false) that subsumed SortPartitions.
## How was this patch tested?
Also updated test cases to reflect the removal.
Author: Reynold Xin <rxin@databricks.com>
Closes #16381 from rxin/SPARK-18973.
Diffstat (limited to 'sql/core')
| -rw-r--r-- | sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala | 4 |
1 files changed, 0 insertions, 4 deletions
diff --git a/sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala b/sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala index b0bbcfc934..ba82ec156e 100644 --- a/sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala +++ b/sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala @@ -376,10 +376,6 @@ abstract class SparkStrategies extends QueryPlanner[SparkPlan] { } else { execution.CoalesceExec(numPartitions, planLater(child)) :: Nil } - case logical.SortPartitions(sortExprs, child) => - // This sort only sorts tuples within a partition. Its requiredDistribution will be - // an UnspecifiedDistribution. - execution.SortExec(sortExprs, global = false, child = planLater(child)) :: Nil case logical.Sort(sortExprs, global, child) => execution.SortExec(sortExprs, global, planLater(child)) :: Nil case logical.Project(projectList, child) => |