diff options
| author | Liang-Chi Hsieh <viirya@gmail.com> | 2015-02-01 17:52:18 -0800 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2015-02-01 17:52:18 -0800 |
| commit | ef89b82d831d1d35dfaa6387ff2077ea2f2073cc (patch) | |
| tree | 8c2479ece3cd5519791bf6d34e9e823ba2e9a897 /sql/catalyst | |
| parent | 883bc88d520b27bdeb74a1837b45ef0b59753568 (diff) | |
| download | spark-ef89b82d831d1d35dfaa6387ff2077ea2f2073cc.tar.gz spark-ef89b82d831d1d35dfaa6387ff2077ea2f2073cc.tar.bz2 spark-ef89b82d831d1d35dfaa6387ff2077ea2f2073cc.zip | |
[Minor][SQL] Little refactor DataFrame related codes
Simplify some codes related to DataFrame.
* Calling `toAttributes` instead of a `map`.
* Original `createDataFrame` creates the `StructType` and its attributes in a redundant way. Refactored it to create `StructType` and call `toAttributes` on it directly.
Author: Liang-Chi Hsieh <viirya@gmail.com>
Closes #4298 from viirya/refactor_df and squashes the following commits:
1d61c64 [Liang-Chi Hsieh] Revert it.
f36efb5 [Liang-Chi Hsieh] Relax the constraint of toDataFrame.
2c9f370 [Liang-Chi Hsieh] Just refactor DataFrame codes.
Diffstat (limited to 'sql/catalyst')
| -rw-r--r-- | sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala index 90646fd25b..e0db587efb 100644 --- a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala +++ b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala @@ -98,7 +98,7 @@ trait ScalaReflection { /** Returns a Sequence of attributes for the given case class type. */ def attributesFor[T: TypeTag]: Seq[Attribute] = schemaFor[T] match { case Schema(s: StructType, _) => - s.fields.map(f => AttributeReference(f.name, f.dataType, f.nullable, f.metadata)()) + s.toAttributes } /** Returns a catalyst DataType and its nullability for the given Scala Type using reflection. */ |