diff options
| author | Michael Armbrust <michael@databricks.com> | 2016-03-21 20:16:01 -0700 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2016-03-21 20:16:01 -0700 |
| commit | 8014a516d1cbb0f0c7035e2149161aa32fb506f8 (patch) | |
| tree | 04e97f30e4e4ef519842589f0421ea21a8479186 /sql/hive | |
| parent | 7299961657b5591a3257b21e40f3047db27f221c (diff) | |
| download | spark-8014a516d1cbb0f0c7035e2149161aa32fb506f8.tar.gz spark-8014a516d1cbb0f0c7035e2149161aa32fb506f8.tar.bz2 spark-8014a516d1cbb0f0c7035e2149161aa32fb506f8.zip | |
[SPARK-13883][SQL] Parquet Implementation of FileFormat.buildReader
This PR add implements the new `buildReader` interface for the Parquet `FileFormat`. An simple implementation of `FileScanRDD` is also included.
This code should be tested by the many existing tests for parquet.
Author: Michael Armbrust <michael@databricks.com>
Author: Sameer Agarwal <sameer@databricks.com>
Author: Nong Li <nong@databricks.com>
Closes #11709 from marmbrus/parquetReader.
Diffstat (limited to 'sql/hive')
| -rw-r--r-- | sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala b/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala index 2806b87f33..bc8896d4bd 100644 --- a/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala +++ b/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala @@ -1724,6 +1724,7 @@ class SQLQuerySuite extends QueryTest with SQLTestUtils with TestHiveSingleton { withTable("tbl10562") { val df = Seq(2012 -> "a").toDF("Year", "val") df.write.partitionBy("Year").saveAsTable("tbl10562") + checkAnswer(sql("SELECT year FROM tbl10562"), Row(2012)) checkAnswer(sql("SELECT Year FROM tbl10562"), Row(2012)) checkAnswer(sql("SELECT yEAr FROM tbl10562"), Row(2012)) checkAnswer(sql("SELECT val FROM tbl10562 WHERE Year > 2015"), Nil) |