diff options
| author | Yin Huai <yhuai@databricks.com> | 2015-02-17 15:47:59 -0800 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2015-02-17 15:48:23 -0800 |
| commit | 07d8ef9e730251b66f962fa7acdaf7d7eacc62a1 (patch) | |
| tree | 21328ad570b1d730d3e9b2dec1c7cd4a9135ad22 /make-distribution.sh | |
| parent | 0dba382ee65694969704384c4968e3a656b3c833 (diff) | |
| download | spark-07d8ef9e730251b66f962fa7acdaf7d7eacc62a1.tar.gz spark-07d8ef9e730251b66f962fa7acdaf7d7eacc62a1.tar.bz2 spark-07d8ef9e730251b66f962fa7acdaf7d7eacc62a1.zip | |
[SPARK-5852][SQL]Fail to convert a newly created empty metastore parquet table to a data source parquet table.
The problem is that after we create an empty hive metastore parquet table (e.g. `CREATE TABLE test (a int) STORED AS PARQUET`), Hive will create an empty dir for us, which cause our data source `ParquetRelation2` fail to get the schema of the table. See JIRA for the case to reproduce the bug and the exception.
This PR is based on #4562 from chenghao-intel.
JIRA: https://issues.apache.org/jira/browse/SPARK-5852
Author: Yin Huai <yhuai@databricks.com>
Author: Cheng Hao <hao.cheng@intel.com>
Closes #4655 from yhuai/CTASParquet and squashes the following commits:
b8b3450 [Yin Huai] Update tests.
2ac94f7 [Yin Huai] Update tests.
3db3d20 [Yin Huai] Minor update.
d7e2308 [Yin Huai] Revert changes in HiveMetastoreCatalog.scala.
36978d1 [Cheng Hao] Update the code as feedback
a04930b [Cheng Hao] fix bug of scan an empty parquet based table
442ffe0 [Cheng Hao] passdown the schema for Parquet File in HiveContext
(cherry picked from commit 117121a4ecaadda156a82255333670775e7727db)
Signed-off-by: Michael Armbrust <michael@databricks.com>
Diffstat (limited to 'make-distribution.sh')
0 files changed, 0 insertions, 0 deletions