diff options
author | Xiangrui Meng <meng@databricks.com> | 2015-04-02 17:57:01 +0800 |
---|---|---|
committer | Michael Armbrust <michael@databricks.com> | 2015-04-02 16:56:21 -0700 |
commit | c2694bba61268d61cb6cdf1a72e493e49c824564 (patch) | |
tree | 42f07b7cd43a401575769a60f144a6635659d70d /project/build.properties | |
parent | e6ee95cbda7a52a40426b9461f34bb611bfcf077 (diff) | |
download | spark-c2694bba61268d61cb6cdf1a72e493e49c824564.tar.gz spark-c2694bba61268d61cb6cdf1a72e493e49c824564.tar.bz2 spark-c2694bba61268d61cb6cdf1a72e493e49c824564.zip |
[SPARK-6672][SQL] convert row to catalyst in createDataFrame(RDD[Row], ...)
We assume that `RDD[Row]` contains Scala types. So we need to convert them into catalyst types in createDataFrame. liancheng
Author: Xiangrui Meng <meng@databricks.com>
Closes #5329 from mengxr/SPARK-6672 and squashes the following commits:
2d52644 [Xiangrui Meng] set needsConversion = false in jsonRDD
06896e4 [Xiangrui Meng] add createDataFrame without conversion
4a3767b [Xiangrui Meng] convert Row to catalyst
(cherry picked from commit 424e987dfebbbaa37f4496d44090d469a931ce76)
Signed-off-by: Michael Armbrust <michael@databricks.com>
Diffstat (limited to 'project/build.properties')
0 files changed, 0 insertions, 0 deletions