diff options
author | Shixiong Zhu <shixiong@databricks.com> | 2016-02-09 16:31:00 -0800 |
---|---|---|
committer | Shixiong Zhu <shixiong@databricks.com> | 2016-02-09 16:31:00 -0800 |
commit | fae830d15846f7ffdfe49eeb45e175a3cdd2c670 (patch) | |
tree | f75dca9c52c908321c1592d838e4ec3874f4181a /conf/spark-defaults.conf.template | |
parent | 7fe4fe630a3fc9755ebd0325bb595d76381633e8 (diff) | |
download | spark-fae830d15846f7ffdfe49eeb45e175a3cdd2c670.tar.gz spark-fae830d15846f7ffdfe49eeb45e175a3cdd2c670.tar.bz2 spark-fae830d15846f7ffdfe49eeb45e175a3cdd2c670.zip |
[SPARK-13245][CORE] Call shuffleMetrics methods only in one thread for ShuffleBlockFetcherIterator
Call shuffleMetrics's incRemoteBytesRead and incRemoteBlocksFetched when polling FetchResult from `results` so as to always use shuffleMetrics in one thread.
Also fix a race condition that could cause memory leak.
Author: Shixiong Zhu <shixiong@databricks.com>
Closes #11138 from zsxwing/SPARK-13245.
Diffstat (limited to 'conf/spark-defaults.conf.template')
0 files changed, 0 insertions, 0 deletions