diff options
| author | Cheng Lian <lian@databricks.com> | 2015-08-08 18:09:48 +0800 |
|---|---|---|
| committer | Cheng Lian <lian@databricks.com> | 2015-08-08 18:09:48 +0800 |
| commit | 11caf1ce290b6931647c2f71268f847d1d48930e (patch) | |
| tree | a6b8ba615404ba7554998901f38671be645bdd3d /python/pyspark/sql/types.py | |
| parent | ef062c15992b0d08554495b8ea837bef3fabf6e9 (diff) | |
| download | spark-11caf1ce290b6931647c2f71268f847d1d48930e.tar.gz spark-11caf1ce290b6931647c2f71268f847d1d48930e.tar.bz2 spark-11caf1ce290b6931647c2f71268f847d1d48930e.zip | |
[SPARK-4176] [SQL] [MINOR] Should use unscaled Long to write decimals for precision <= 18 rather than 8
This PR fixes a minor bug introduced in #7455: when writing decimals, we should use the unscaled Long for better performance when the precision <= 18 rather than 8 (should be a typo). This bug doesn't affect correctness, but hurts Parquet decimal writing performance.
This PR also replaced similar magic numbers with newly defined constants.
Author: Cheng Lian <lian@databricks.com>
Closes #8031 from liancheng/spark-4176/minor-fix-for-writing-decimals and squashes the following commits:
10d4ea3 [Cheng Lian] Should use unscaled Long to write decimals for precision <= 18 rather than 8
Diffstat (limited to 'python/pyspark/sql/types.py')
0 files changed, 0 insertions, 0 deletions