diff options
| author | Sameer Agarwal <sameer@databricks.com> | 2016-01-26 07:50:37 -0800 |
|---|---|---|
| committer | Yin Huai <yhuai@databricks.com> | 2016-01-26 07:50:37 -0800 |
| commit | 08c781ca672820be9ba32838bbe40d2643c4bde4 (patch) | |
| tree | 7d77b7fb5a18967125ddaf4736fb98ecd83ec88f /docs/streaming-custom-receivers.md | |
| parent | ae0309a8812a4fade3a0ea67d8986ca870aeb9eb (diff) | |
| download | spark-08c781ca672820be9ba32838bbe40d2643c4bde4.tar.gz spark-08c781ca672820be9ba32838bbe40d2643c4bde4.tar.bz2 spark-08c781ca672820be9ba32838bbe40d2643c4bde4.zip | |
[SPARK-12682][SQL] Add support for (optionally) not storing tables in hive metadata format
This PR adds a new table option (`skip_hive_metadata`) that'd allow the user to skip storing the table metadata in hive metadata format. While this could be useful in general, the specific use-case for this change is that Hive doesn't handle wide schemas well (see https://issues.apache.org/jira/browse/SPARK-12682 and https://issues.apache.org/jira/browse/SPARK-6024) which in turn prevents such tables from being queried in SparkSQL.
Author: Sameer Agarwal <sameer@databricks.com>
Closes #10826 from sameeragarwal/skip-hive-metadata.
Diffstat (limited to 'docs/streaming-custom-receivers.md')
0 files changed, 0 insertions, 0 deletions