diff options
| author | Sameer Agarwal <sameer@databricks.com> | 2016-03-31 11:56:28 -0700 |
|---|---|---|
| committer | Yin Huai <yhuai@databricks.com> | 2016-03-31 11:56:28 -0700 |
| commit | 3586929320bba8b8d09c2a451189f76821fdfba4 (patch) | |
| tree | c3883d65b6ea621e36895bf4686b355ba22829ae | |
| parent | 8d6207206c9fd71178417c12cdacf368362df4d8 (diff) | |
| download | spark-3586929320bba8b8d09c2a451189f76821fdfba4.tar.gz spark-3586929320bba8b8d09c2a451189f76821fdfba4.tar.bz2 spark-3586929320bba8b8d09c2a451189f76821fdfba4.zip | |
[SPARK-14278][SQL] Initialize columnar batch with proper memory mode
## What changes were proposed in this pull request?
Fixes a minor bug in the record reader constructor that was possibly introduced during refactoring.
## How was this patch tested?
N/A
Author: Sameer Agarwal <sameer@databricks.com>
Closes #12070 from sameeragarwal/vectorized-rr.
| -rw-r--r-- | sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedParquetRecordReader.java | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedParquetRecordReader.java b/sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedParquetRecordReader.java index 0bdf4aab29..a0b6276ef5 100644 --- a/sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedParquetRecordReader.java +++ b/sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedParquetRecordReader.java @@ -191,7 +191,7 @@ public class VectorizedParquetRecordReader extends SpecificParquetRecordReaderBa } } - columnarBatch = ColumnarBatch.allocate(batchSchema); + columnarBatch = ColumnarBatch.allocate(batchSchema, memMode); if (partitionColumns != null) { int partitionIdx = sparkSchema.fields().length; for (int i = 0; i < partitionColumns.fields().length; i++) { |