diff options
| author | Cheng Lian <lian@databricks.com> | 2015-07-25 11:42:49 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-07-25 11:42:49 -0700 |
| commit | e2ec018e37cb699077b5fa2bd662f2055cb42296 (patch) | |
| tree | afe34287bd1b1d9304394eb381b33569dc5fb4ca /sql/hive | |
| parent | c980e20cf17f2980c564beab9b241022872e29ea (diff) | |
| download | spark-e2ec018e37cb699077b5fa2bd662f2055cb42296.tar.gz spark-e2ec018e37cb699077b5fa2bd662f2055cb42296.tar.bz2 spark-e2ec018e37cb699077b5fa2bd662f2055cb42296.zip | |
[SPARK-9285] [SQL] Fixes Row/InternalRow conversion for HadoopFsRelation
This is a follow-up of #7626. It fixes `Row`/`InternalRow` conversion for data sources extending `HadoopFsRelation` with `needConversion` being `true`.
Author: Cheng Lian <lian@databricks.com>
Closes #7649 from liancheng/spark-9285-conversion-fix and squashes the following commits:
036a50c [Cheng Lian] Addresses PR comment
f6d7c6a [Cheng Lian] Fixes Row/InternalRow conversion for HadoopFsRelation
Diffstat (limited to 'sql/hive')
| -rw-r--r-- | sql/hive/src/test/scala/org/apache/spark/sql/sources/SimpleTextHadoopFsRelationSuite.scala | 5 |
1 files changed, 0 insertions, 5 deletions
diff --git a/sql/hive/src/test/scala/org/apache/spark/sql/sources/SimpleTextHadoopFsRelationSuite.scala b/sql/hive/src/test/scala/org/apache/spark/sql/sources/SimpleTextHadoopFsRelationSuite.scala index d761909d60..e8975e5f5c 100644 --- a/sql/hive/src/test/scala/org/apache/spark/sql/sources/SimpleTextHadoopFsRelationSuite.scala +++ b/sql/hive/src/test/scala/org/apache/spark/sql/sources/SimpleTextHadoopFsRelationSuite.scala @@ -22,10 +22,6 @@ import org.apache.hadoop.fs.Path import org.apache.spark.deploy.SparkHadoopUtil import org.apache.spark.sql.types.{IntegerType, StructField, StructType} -/* -This is commented out due a bug in the data source API (SPARK-9291). - - class SimpleTextHadoopFsRelationSuite extends HadoopFsRelationTest { override val dataSourceName: String = classOf[SimpleTextSource].getCanonicalName @@ -54,4 +50,3 @@ class SimpleTextHadoopFsRelationSuite extends HadoopFsRelationTest { } } } -*/ |