diff options
author | Cheng Lian <lian@databricks.com> | 2016-07-21 22:08:34 +0800 |
---|---|---|
committer | Cheng Lian <lian@databricks.com> | 2016-07-21 22:08:34 +0800 |
commit | 69626adddc0441a4834b70a32e2d95b11d69a219 (patch) | |
tree | f3e69b9bff4d757b606a58a1c1cc05f255159336 /sql/core/src/test | |
parent | 6203668d50c1193cde20b0c35f95cf12dabc0805 (diff) | |
download | spark-69626adddc0441a4834b70a32e2d95b11d69a219.tar.gz spark-69626adddc0441a4834b70a32e2d95b11d69a219.tar.bz2 spark-69626adddc0441a4834b70a32e2d95b11d69a219.zip |
[SPARK-16632][SQL] Revert PR #14272: Respect Hive schema when merging parquet schema
## What changes were proposed in this pull request?
PR #14278 is a more general and simpler fix for SPARK-16632 than PR #14272. After merging #14278, we no longer need changes made in #14272. So here I revert them.
This PR targets both master and branch-2.0.
## How was this patch tested?
Existing tests.
Author: Cheng Lian <lian@databricks.com>
Closes #14300 from liancheng/revert-pr-14272.
Diffstat (limited to 'sql/core/src/test')
-rw-r--r-- | sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaSuite.scala | 39 |
1 files changed, 0 insertions, 39 deletions
diff --git a/sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaSuite.scala b/sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaSuite.scala index 31ebec096d..8a980a7eb5 100644 --- a/sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaSuite.scala +++ b/sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaSuite.scala @@ -1581,43 +1581,4 @@ class ParquetSchemaSuite extends ParquetSchemaTest { | } |} """.stripMargin) - - testSchemaClipping( - "int32 parquet field with byte schema field", - - parquetSchema = - """message root { - | optional int32 value; - |} - """.stripMargin, - - catalystSchema = - new StructType() - .add("value", ByteType, nullable = true), - - expectedSchema = - """message root { - | optional int32 value (INT_8); - |} - """.stripMargin) - - testSchemaClipping( - "int32 parquet field with short schema field", - - parquetSchema = - """message root { - | optional int32 value; - |} - """.stripMargin, - - catalystSchema = - new StructType() - .add("value", ShortType, nullable = true), - - expectedSchema = - """message root { - | optional int32 value (INT_16); - |} - """.stripMargin) - } |