diff options
author | Michael Armbrust <michael@databricks.com> | 2014-11-16 21:55:57 -0800 |
---|---|---|
committer | Reynold Xin <rxin@databricks.com> | 2014-11-16 21:56:30 -0800 |
commit | 8305e803e23808507b68fa9a6876ee455e58ac27 (patch) | |
tree | 9120aa92a106e61a112c139339767d3e74c743bb /network/yarn | |
parent | f3b93c1bac292fccb05bf16d1da4b1863b3031fd (diff) | |
download | spark-8305e803e23808507b68fa9a6876ee455e58ac27.tar.gz spark-8305e803e23808507b68fa9a6876ee455e58ac27.tar.bz2 spark-8305e803e23808507b68fa9a6876ee455e58ac27.zip |
[SPARK-4410][SQL] Add support for external sort
Adds a new operator that uses Spark's `ExternalSort` class. It is off by default now, but we might consider making it the default if benchmarks show that it does not regress performance.
Author: Michael Armbrust <michael@databricks.com>
Closes #3268 from marmbrus/externalSort and squashes the following commits:
48b9726 [Michael Armbrust] comments
b98799d [Michael Armbrust] Add test
afd7562 [Michael Armbrust] Add support for external sort.
(cherry picked from commit 64c6b9bad559c21f25cd9fbe37c8813cdab939f2)
Signed-off-by: Reynold Xin <rxin@databricks.com>
Diffstat (limited to 'network/yarn')
0 files changed, 0 insertions, 0 deletions