diff options
| author | Yin Huai <yhuai@databricks.com> | 2015-08-05 19:19:09 -0700 |
|---|---|---|
| committer | Yin Huai <yhuai@databricks.com> | 2015-08-05 19:19:09 -0700 |
| commit | 4581badbc8aa7e5a37ba7f7f83cc3860240f5dd3 (patch) | |
| tree | 7a67455f97f5915aa1f47a0efadd33f812dede1e /unsafe/src | |
| parent | 4399b7b0903d830313ab7e69731c11d587ae567c (diff) | |
| download | spark-4581badbc8aa7e5a37ba7f7f83cc3860240f5dd3.tar.gz spark-4581badbc8aa7e5a37ba7f7f83cc3860240f5dd3.tar.bz2 spark-4581badbc8aa7e5a37ba7f7f83cc3860240f5dd3.zip | |
[SPARK-9611] [SQL] Fixes a few corner cases when we spill a UnsafeFixedWidthAggregationMap
This PR has the following three small fixes.
1. UnsafeKVExternalSorter does not use 0 as the initialSize to create an UnsafeInMemorySorter if its BytesToBytesMap is empty.
2. We will not not spill a InMemorySorter if it is empty.
3. We will not add a SpillReader to a SpillMerger if this SpillReader is empty.
JIRA: https://issues.apache.org/jira/browse/SPARK-9611
Author: Yin Huai <yhuai@databricks.com>
Closes #7948 from yhuai/unsafeEmptyMap and squashes the following commits:
9727abe [Yin Huai] Address Josh's comments.
34b6f76 [Yin Huai] 1. UnsafeKVExternalSorter does not use 0 as the initialSize to create an UnsafeInMemorySorter if its BytesToBytesMap is empty. 2. Do not spill a InMemorySorter if it is empty. 3. Do not add spill to SpillMerger if this spill is empty.
Diffstat (limited to 'unsafe/src')
0 files changed, 0 insertions, 0 deletions