diff options
| author | Yin Huai <yhuai@databricks.com> | 2015-08-07 20:04:17 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-08-07 20:04:17 -0700 |
| commit | c564b27447ed99e55b359b3df1d586d5766b85ea (patch) | |
| tree | c2a1e50942d036cc5ceb0f118be6710230a2136f /core | |
| parent | 998f4ff94df1d9db1c9e32c04091017c25cd4e81 (diff) | |
| download | spark-c564b27447ed99e55b359b3df1d586d5766b85ea.tar.gz spark-c564b27447ed99e55b359b3df1d586d5766b85ea.tar.bz2 spark-c564b27447ed99e55b359b3df1d586d5766b85ea.zip | |
[SPARK-9753] [SQL] TungstenAggregate should also accept InternalRow instead of just UnsafeRow
https://issues.apache.org/jira/browse/SPARK-9753
This PR makes TungstenAggregate to accept `InternalRow` instead of just `UnsafeRow`. Also, it adds an `getAggregationBufferFromUnsafeRow` method to `UnsafeFixedWidthAggregationMap`. It is useful when we already have grouping keys stored in `UnsafeRow`s. Finally, it wraps `InputStream` and `OutputStream` in `UnsafeRowSerializer` with `BufferedInputStream` and `BufferedOutputStream`, respectively.
Author: Yin Huai <yhuai@databricks.com>
Closes #8041 from yhuai/joinedRowForProjection and squashes the following commits:
7753e34 [Yin Huai] Use BufferedInputStream and BufferedOutputStream.
d68b74e [Yin Huai] Use joinedRow instead of UnsafeRowJoiner.
e93c009 [Yin Huai] Add getAggregationBufferFromUnsafeRow for cases that the given groupingKeyRow is already an UnsafeRow.
Diffstat (limited to 'core')
0 files changed, 0 insertions, 0 deletions