diff options
| author | jiangxingbo <jiangxb1987@gmail.com> | 2016-11-08 15:11:03 +0100 |
|---|---|---|
| committer | Herman van Hovell <hvanhovell@databricks.com> | 2016-11-08 15:11:03 +0100 |
| commit | 344dcad70173abcb348c68fdb0219960b5b06635 (patch) | |
| tree | 703279c99408b5ceeb872a36ef4d3eb68c9b2721 /streaming | |
| parent | b1033fb74595716a8973acae43a6415d8e0a76d2 (diff) | |
| download | spark-344dcad70173abcb348c68fdb0219960b5b06635.tar.gz spark-344dcad70173abcb348c68fdb0219960b5b06635.tar.bz2 spark-344dcad70173abcb348c68fdb0219960b5b06635.zip | |
[SPARK-17868][SQL] Do not use bitmasks during parsing and analysis of CUBE/ROLLUP/GROUPING SETS
## What changes were proposed in this pull request?
We generate bitmasks for grouping sets during the parsing process, and use these during analysis. These bitmasks are difficult to work with in practice and have lead to numerous bugs. This PR removes these and use actual sets instead, however we still need to generate these offsets for the grouping_id.
This PR does the following works:
1. Replace bitmasks by actual grouping sets durning Parsing/Analysis stage of CUBE/ROLLUP/GROUPING SETS;
2. Add new testsuite `ResolveGroupingAnalyticsSuite` to test the `Analyzer.ResolveGroupingAnalytics` rule directly;
3. Fix a minor bug in `ResolveGroupingAnalytics`.
## How was this patch tested?
By existing test cases, and add new testsuite `ResolveGroupingAnalyticsSuite` to test directly.
Author: jiangxingbo <jiangxb1987@gmail.com>
Closes #15484 from jiangxb1987/group-set.
Diffstat (limited to 'streaming')
0 files changed, 0 insertions, 0 deletions