diff options
| author | Reynold Xin <rxin@databricks.com> | 2015-02-16 19:00:30 -0800 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-02-16 19:00:30 -0800 |
| commit | 0e180bfc3c7f18780d4fc4f42681609832418e43 (patch) | |
| tree | e87dc86f26072db58ec4e71030c782d197e65e46 /sql/hive | |
| parent | 58a82a7882d7a8a7e4064278c4bf28607d9a42ba (diff) | |
| download | spark-0e180bfc3c7f18780d4fc4f42681609832418e43.tar.gz spark-0e180bfc3c7f18780d4fc4f42681609832418e43.tar.bz2 spark-0e180bfc3c7f18780d4fc4f42681609832418e43.zip | |
[SQL] Various DataFrame doc changes.
Added a bunch of tags.
Also changed parquetFile to take varargs rather than a string followed by varargs.
Author: Reynold Xin <rxin@databricks.com>
Closes #4636 from rxin/df-doc and squashes the following commits:
651f80c [Reynold Xin] Fixed parquetFile in PySpark.
8dc3024 [Reynold Xin] [SQL] Various DataFrame doc changes.
Diffstat (limited to 'sql/hive')
| -rw-r--r-- | sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala index d2c39ab621..e63cea6045 100644 --- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala +++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala @@ -143,7 +143,7 @@ private[hive] trait HiveStrategies { PhysicalRDD(plan.output, sparkContext.emptyRDD[Row]) :: Nil } else { hiveContext - .parquetFile(partitionLocations.head, partitionLocations.tail: _*) + .parquetFile(partitionLocations: _*) .addPartitioningAttributes(relation.partitionKeys) .lowerCase .where(unresolvedOtherPredicates) @@ -152,6 +152,7 @@ private[hive] trait HiveStrategies { .executedPlan .fakeOutput(projectList.map(_.toAttribute)) :: Nil } + } else { hiveContext .parquetFile(relation.hiveQlTable.getDataLocation.toString) |