diff options
| author | Davies Liu <davies@databricks.com> | 2016-01-06 23:21:52 -0800 |
|---|---|---|
| committer | Davies Liu <davies.liu@gmail.com> | 2016-01-06 23:21:52 -0800 |
| commit | 6a1c864ab6ee3e869a16ffdbaf6fead21c7aac6d (patch) | |
| tree | f5096b12f8539866286f6ff6a97281bf6f10a86d /core/pom.xml | |
| parent | 84e77a15df18ba3f1cc871a3c52c783b46e52369 (diff) | |
| download | spark-6a1c864ab6ee3e869a16ffdbaf6fead21c7aac6d.tar.gz spark-6a1c864ab6ee3e869a16ffdbaf6fead21c7aac6d.tar.bz2 spark-6a1c864ab6ee3e869a16ffdbaf6fead21c7aac6d.zip | |
[SPARK-12295] [SQL] external spilling for window functions
This PR manage the memory used by window functions (buffered rows), also enable external spilling.
After this PR, we can run window functions on a partition with hundreds of millions of rows with only 1G.
Author: Davies Liu <davies@databricks.com>
Closes #10605 from davies/unsafe_window.
Diffstat (limited to 'core/pom.xml')
0 files changed, 0 insertions, 0 deletions