diff options
| author | Cheng Hao <hao.cheng@intel.com> | 2015-08-06 11:13:44 +0800 |
|---|---|---|
| committer | Cheng Lian <lian@databricks.com> | 2015-08-06 11:13:44 +0800 |
| commit | 119b59053870df7be899bf5c1c0d321406af96f9 (patch) | |
| tree | b27e06fb75ea4a7c6c0bb128ab8a2de532c1c1f2 /unsafe/src | |
| parent | 4581badbc8aa7e5a37ba7f7f83cc3860240f5dd3 (diff) | |
| download | spark-119b59053870df7be899bf5c1c0d321406af96f9.tar.gz spark-119b59053870df7be899bf5c1c0d321406af96f9.tar.bz2 spark-119b59053870df7be899bf5c1c0d321406af96f9.zip | |
[SPARK-6923] [SPARK-7550] [SQL] Persists data source relations in Hive compatible format when possible
This PR is a fork of PR #5733 authored by chenghao-intel. For committers who's going to merge this PR, please set the author to "Cheng Hao <hao.chengintel.com>".
----
When a data source relation meets the following requirements, we persist it in Hive compatible format, so that other systems like Hive can access it:
1. It's a `HadoopFsRelation`
2. It has only one input path
3. It's non-partitioned
4. It's data source provider can be naturally mapped to a Hive builtin SerDe (e.g. ORC and Parquet)
Author: Cheng Lian <lian@databricks.com>
Author: Cheng Hao <hao.cheng@intel.com>
Closes #7967 from liancheng/spark-6923/refactoring-pr-5733 and squashes the following commits:
5175ee6 [Cheng Lian] Fixes an oudated comment
3870166 [Cheng Lian] Fixes build error and comments
864acee [Cheng Lian] Refactors PR #5733
3490cdc [Cheng Hao] update the scaladoc
6f57669 [Cheng Hao] write schema info to hivemetastore for data source
Diffstat (limited to 'unsafe/src')
0 files changed, 0 insertions, 0 deletions