diff options
| author | Davies Liu <davies@databricks.com> | 2016-05-18 09:44:21 -0700 |
|---|---|---|
| committer | Davies Liu <davies.liu@gmail.com> | 2016-05-18 09:44:21 -0700 |
| commit | 8fb1d1c7f3ed1b62625052a532b7388ebec71bbf (patch) | |
| tree | 76c973c4bc76359f29ba1b22aede20808eaf469d /project | |
| parent | c1fd9cacba8e602cc55a893f0beb05ea48c3a1f6 (diff) | |
| download | spark-8fb1d1c7f3ed1b62625052a532b7388ebec71bbf.tar.gz spark-8fb1d1c7f3ed1b62625052a532b7388ebec71bbf.tar.bz2 spark-8fb1d1c7f3ed1b62625052a532b7388ebec71bbf.zip | |
[SPARK-15357] Cooperative spilling should check consumer memory mode
## What changes were proposed in this pull request?
Since we support forced spilling for Spillable, which only works in OnHeap mode, different from other SQL operators (could be OnHeap or OffHeap), we should considering the mode of consumer before calling trigger forced spilling.
## How was this patch tested?
Add new test.
Author: Davies Liu <davies@databricks.com>
Closes #13151 from davies/fix_mode.
Diffstat (limited to 'project')
| -rw-r--r-- | project/MimaExcludes.scala | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index 45f7297048..4e99a09657 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -40,6 +40,7 @@ object MimaExcludes { excludePackage("org.spark-project.jetty"), excludePackage("org.apache.spark.unused"), excludePackage("org.apache.spark.unsafe"), + excludePackage("org.apache.spark.memory"), excludePackage("org.apache.spark.util.collection.unsafe"), excludePackage("org.apache.spark.sql.catalyst"), excludePackage("org.apache.spark.sql.execution"), |