diff options
| author | Nong Li <nong@databricks.com> | 2016-01-04 14:58:24 -0800 |
|---|---|---|
| committer | Yin Huai <yhuai@databricks.com> | 2016-01-04 14:58:24 -0800 |
| commit | 34de24abb518e95c4312b77aa107d061ce02c835 (patch) | |
| tree | d90e651789b15e4f1f3a4dde9e3ca2ddbea8bdf9 /python/pyspark/sql/context.py | |
| parent | d084a2de3271fd8b0d29ee67e1e214e8b9d96d6d (diff) | |
| download | spark-34de24abb518e95c4312b77aa107d061ce02c835.tar.gz spark-34de24abb518e95c4312b77aa107d061ce02c835.tar.bz2 spark-34de24abb518e95c4312b77aa107d061ce02c835.zip | |
[SPARK-12589][SQL] Fix UnsafeRowParquetRecordReader to properly set the row length.
The reader was previously not setting the row length meaning it was wrong if there were variable
length columns. This problem does not manifest usually, since the value in the column is correct and
projecting the row fixes the issue.
Author: Nong Li <nong@databricks.com>
Closes #10576 from nongli/spark-12589.
Diffstat (limited to 'python/pyspark/sql/context.py')
0 files changed, 0 insertions, 0 deletions