diff options
| author | Sameer Agarwal <sameerag@cs.berkeley.edu> | 2016-07-25 22:31:01 +0800 |
|---|---|---|
| committer | Cheng Lian <lian@databricks.com> | 2016-07-25 22:31:01 +0800 |
| commit | d6a52176ade92853f37167ad27631977dc79bc76 (patch) | |
| tree | 1748cec9b5520215cef6bd745c5808989ff69c1d /sql/catalyst | |
| parent | 64529b186a1c33740067cc7639d630bc5b9ae6e8 (diff) | |
| download | spark-d6a52176ade92853f37167ad27631977dc79bc76.tar.gz spark-d6a52176ade92853f37167ad27631977dc79bc76.tar.bz2 spark-d6a52176ade92853f37167ad27631977dc79bc76.zip | |
[SPARK-16668][TEST] Test parquet reader for row groups containing both dictionary and plain encoded pages
## What changes were proposed in this pull request?
This patch adds an explicit test for [SPARK-14217] by setting the parquet dictionary and page size the generated parquet file spans across 3 pages (within a single row group) where the first page is dictionary encoded and the remaining two are plain encoded.
## How was this patch tested?
1. ParquetEncodingSuite
2. Also manually tested that this test fails without https://github.com/apache/spark/pull/12279
Author: Sameer Agarwal <sameerag@cs.berkeley.edu>
Closes #14304 from sameeragarwal/hybrid-encoding-test.
Diffstat (limited to 'sql/catalyst')
0 files changed, 0 insertions, 0 deletions