diff options
| author | Cheng Hao <hao.cheng@intel.com> | 2014-10-28 14:36:06 -0700 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2014-10-28 14:36:06 -0700 |
| commit | 4b55482abf899c27da3d55401ad26b4e9247b327 (patch) | |
| tree | 53d9bff976ad43beff49a7b20e010f0de0cee793 /sql/hive/compatibility/src/test/scala | |
| parent | abcafcfba38d7c8dba68a5510475c5c49ae54d92 (diff) | |
| download | spark-4b55482abf899c27da3d55401ad26b4e9247b327.tar.gz spark-4b55482abf899c27da3d55401ad26b4e9247b327.tar.bz2 spark-4b55482abf899c27da3d55401ad26b4e9247b327.zip | |
[SPARK-3343] [SQL] Add serde support for CTAS
Currently, `CTAS` (Create Table As Select) doesn't support specifying the `SerDe` in HQL. This PR will pass down the `ASTNode` into the physical operator `execution.CreateTableAsSelect`, which will extract the `CreateTableDesc` object via Hive `SemanticAnalyzer`. In the meantime, I also update the `HiveMetastoreCatalog.createTable` to optionally support the `CreateTableDesc` for table creation.
Author: Cheng Hao <hao.cheng@intel.com>
Closes #2570 from chenghao-intel/ctas_serde and squashes the following commits:
e011ef5 [Cheng Hao] shim for both 0.12 & 0.13.1
cfb3662 [Cheng Hao] revert to hive 0.12
c8a547d [Cheng Hao] Support SerDe properties within CTAS
Diffstat (limited to 'sql/hive/compatibility/src/test/scala')
| -rw-r--r-- | sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala | 6 |
1 files changed, 5 insertions, 1 deletions
diff --git a/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala b/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala index 4fc26d6f55..26d9ca05c8 100644 --- a/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala +++ b/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala @@ -229,7 +229,11 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter { // Needs constant object inspectors "udf_round", - "udf7" + "udf7", + + // Sort with Limit clause causes failure. + "ctas", + "ctas_hadoop20" ) ++ HiveShim.compatibilityBlackList /** |