diff options
| author | Cheng Lian <lian@databricks.com> | 2015-08-13 16:16:50 +0800 |
|---|---|---|
| committer | Cheng Lian <lian@databricks.com> | 2015-08-13 16:16:50 +0800 |
| commit | 69930310115501f0de094fe6f5c6c60dade342bd (patch) | |
| tree | 88f24cb0135e0b8ef201f268acf79b2815f914db /mllib | |
| parent | 84a27916a62980c8fcb0977c3a7fdb73c0bd5812 (diff) | |
| download | spark-69930310115501f0de094fe6f5c6c60dade342bd.tar.gz spark-69930310115501f0de094fe6f5c6c60dade342bd.tar.bz2 spark-69930310115501f0de094fe6f5c6c60dade342bd.zip | |
[SPARK-9757] [SQL] Fixes persistence of Parquet relation with decimal column
PR #7967 enables us to save data source relations to metastore in Hive compatible format when possible. But it fails to persist Parquet relations with decimal column(s) to Hive metastore of versions lower than 1.2.0. This is because `ParquetHiveSerDe` in Hive versions prior to 1.2.0 doesn't support decimal. This PR checks for this case and falls back to Spark SQL specific metastore table format.
Author: Yin Huai <yhuai@databricks.com>
Author: Cheng Lian <lian@databricks.com>
Closes #8130 from liancheng/spark-9757/old-hive-parquet-decimal.
Diffstat (limited to 'mllib')
0 files changed, 0 insertions, 0 deletions