diff options
| author | zsxwing <zsxwing@gmail.com> | 2015-08-11 12:39:13 -0700 |
|---|---|---|
| committer | Yin Huai <yhuai@databricks.com> | 2015-08-11 12:39:13 -0700 |
| commit | 5831294a7a8fa2524133c5d718cbc8187d2b0620 (patch) | |
| tree | 28b256179c248c11a322775f0aabf95cd9239bfd /network | |
| parent | 5b8bb1b213b8738f563fcd00747604410fbb3087 (diff) | |
| download | spark-5831294a7a8fa2524133c5d718cbc8187d2b0620.tar.gz spark-5831294a7a8fa2524133c5d718cbc8187d2b0620.tar.bz2 spark-5831294a7a8fa2524133c5d718cbc8187d2b0620.zip | |
[SPARK-9646] [SQL] Add metrics for all join and aggregate operators
This PR added metrics for all join and aggregate operators. However, I found the metrics may be confusing in the following two case:
1. The iterator is not totally consumed and the metric values will be less.
2. Recreating the iterators will make metric values look bigger than the size of the input source, such as `CartesianProduct`.
Author: zsxwing <zsxwing@gmail.com>
Closes #8060 from zsxwing/sql-metrics and squashes the following commits:
40f3fc1 [zsxwing] Mark LongSQLMetric private[metric] to avoid using incorrectly and leak memory
b1b9071 [zsxwing] Merge branch 'master' into sql-metrics
4bef25a [zsxwing] Add metrics for SortMergeOuterJoin
95ccfc6 [zsxwing] Merge branch 'master' into sql-metrics
67cb4dd [zsxwing] Add metrics for Project and TungstenProject; remove metrics from PhysicalRDD and LocalTableScan
0eb47d4 [zsxwing] Merge branch 'master' into sql-metrics
dd9d932 [zsxwing] Avoid creating new Iterators
589ea26 [zsxwing] Add metrics for all join and aggregate operators
Diffstat (limited to 'network')
0 files changed, 0 insertions, 0 deletions