diff options
| author | Ilya Ganelin <ilya.ganelin@capitalone.com> | 2015-03-13 13:21:04 +0000 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-03-13 13:21:04 +0000 |
| commit | 0af9ea74a07ecdc08c43fa63cb9c9f0c57e3029b (patch) | |
| tree | bdee712a5d184d255dd33b3723a628ca74c43b13 /docs/sql-programming-guide.md | |
| parent | 3980ebdf188d77799b55b407b115cdc82f51d532 (diff) | |
| download | spark-0af9ea74a07ecdc08c43fa63cb9c9f0c57e3029b.tar.gz spark-0af9ea74a07ecdc08c43fa63cb9c9f0c57e3029b.tar.bz2 spark-0af9ea74a07ecdc08c43fa63cb9c9f0c57e3029b.zip | |
[SPARK-5845][Shuffle] Time to cleanup spilled shuffle files not included in shuffle write time
I've added a timer in the right place to fix this inaccuracy.
Author: Ilya Ganelin <ilya.ganelin@capitalone.com>
Closes #4965 from ilganeli/SPARK-5845 and squashes the following commits:
bfabf88 [Ilya Ganelin] Changed to using a foreach vs. getorelse
3e059b0 [Ilya Ganelin] Switched to using getorelse
b946d08 [Ilya Ganelin] Fixed error with option
9434b50 [Ilya Ganelin] Merge remote-tracking branch 'upstream/master' into SPARK-5845
db8647e [Ilya Ganelin] Added update for shuffleWriteTime around spilled file cleanup in ExternalSorter
Diffstat (limited to 'docs/sql-programming-guide.md')
0 files changed, 0 insertions, 0 deletions