diff options
| author | Andrew Or <andrew@databricks.com> | 2015-10-15 14:50:01 -0700 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2015-10-15 14:50:01 -0700 |
| commit | 3b364ff0a4f38c2b8023429a55623de32be5f329 (patch) | |
| tree | f92eb705e349bb571cee3ea33acc6ac2564b1354 /sql/core | |
| parent | 2d000124b72d0ff9e3ecefa03923405642516c4c (diff) | |
| download | spark-3b364ff0a4f38c2b8023429a55623de32be5f329.tar.gz spark-3b364ff0a4f38c2b8023429a55623de32be5f329.tar.bz2 spark-3b364ff0a4f38c2b8023429a55623de32be5f329.zip | |
[SPARK-11078] Ensure spilling tests actually spill
#9084 uncovered that many tests that test spilling don't actually spill. This is a follow-up patch to fix that to ensure our unit tests actually catch potential bugs in spilling. The size of this patch is inflated by the refactoring of `ExternalSorterSuite`, which had a lot of duplicate code and logic.
Author: Andrew Or <andrew@databricks.com>
Closes #9124 from andrewor14/spilling-tests.
Diffstat (limited to 'sql/core')
| -rw-r--r-- | sql/core/src/test/scala/org/apache/spark/sql/execution/TestShuffleMemoryManager.scala | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/sql/core/src/test/scala/org/apache/spark/sql/execution/TestShuffleMemoryManager.scala b/sql/core/src/test/scala/org/apache/spark/sql/execution/TestShuffleMemoryManager.scala index 835f52fa56..c4358f409b 100644 --- a/sql/core/src/test/scala/org/apache/spark/sql/execution/TestShuffleMemoryManager.scala +++ b/sql/core/src/test/scala/org/apache/spark/sql/execution/TestShuffleMemoryManager.scala @@ -68,6 +68,8 @@ private class GrantEverythingMemoryManager extends MemoryManager { blockId: BlockId, numBytes: Long, evictedBlocks: mutable.Buffer[(BlockId, BlockStatus)]): Boolean = true + override def releaseExecutionMemory(numBytes: Long): Unit = { } + override def releaseStorageMemory(numBytes: Long): Unit = { } override def maxExecutionMemory: Long = Long.MaxValue override def maxStorageMemory: Long = Long.MaxValue } |