diff options
author | Eric Liang <ekl@databricks.com> | 2016-05-11 11:25:46 -0700 |
---|---|---|
committer | Davies Liu <davies.liu@gmail.com> | 2016-05-11 11:25:46 -0700 |
commit | 6d0368ab8d1043735e5fe89f801aae1c6826876c (patch) | |
tree | eba9c39405dc0d7bd9a4f2cf10af7e494d6a6742 /external | |
parent | 29314379729de4082bd2297c9e5289e3e4a0115e (diff) | |
download | spark-6d0368ab8d1043735e5fe89f801aae1c6826876c.tar.gz spark-6d0368ab8d1043735e5fe89f801aae1c6826876c.tar.bz2 spark-6d0368ab8d1043735e5fe89f801aae1c6826876c.zip |
[SPARK-15259] Sort time metric should not include spill and record insertion time
## What changes were proposed in this pull request?
After SPARK-14669 it seems the sort time metric includes both spill and record insertion time. This makes it not very useful since the metric becomes close to the total execution time of the node.
We should track just the time spent for in-memory sort, as before.
## How was this patch tested?
Verified metric in the UI, also unit test on UnsafeExternalRowSorter.
cc davies
Author: Eric Liang <ekl@databricks.com>
Author: Eric Liang <ekhliang@gmail.com>
Closes #13035 from ericl/fix-metrics.
Diffstat (limited to 'external')
0 files changed, 0 insertions, 0 deletions