diff options
| author | Nong Li <nong@databricks.com> | 2016-02-08 22:21:26 -0800 |
|---|---|---|
| committer | Davies Liu <davies.liu@gmail.com> | 2016-02-08 22:21:26 -0800 |
| commit | 3708d13f1a282a9ebf12e3b736f1aa1712cbacd5 (patch) | |
| tree | fe654891efa6dcc0c67612bfb437b441dffa1793 /docs | |
| parent | eeaf45b92695c577279f3a17d8c80ee40425e9aa (diff) | |
| download | spark-3708d13f1a282a9ebf12e3b736f1aa1712cbacd5.tar.gz spark-3708d13f1a282a9ebf12e3b736f1aa1712cbacd5.tar.bz2 spark-3708d13f1a282a9ebf12e3b736f1aa1712cbacd5.zip | |
[SPARK-12992] [SQL] Support vectorized decoding in UnsafeRowParquetRecordReader.
WIP: running tests. Code needs a bit of clean up.
This patch completes the vectorized decoding with the goal of passing the existing
tests. There is still more patches to support the rest of the format spec, even
just for flat schemas.
This patch adds a new flag to enable the vectorized decoding. Tests were updated
to try with both modes where applicable.
Once this is working well, we can remove the previous code path.
Author: Nong Li <nong@databricks.com>
Closes #11055 from nongli/spark-12992-2.
Diffstat (limited to 'docs')
0 files changed, 0 insertions, 0 deletions