diff options
| author | Xiangrui Meng <meng@databricks.com> | 2015-04-02 17:57:01 +0800 |
|---|---|---|
| committer | Cheng Lian <lian@databricks.com> | 2015-04-02 17:57:01 +0800 |
| commit | 424e987dfebbbaa37f4496d44090d469a931ce76 (patch) | |
| tree | 0a5c5341c94ee34c1e700252f8764c4a0de6cf68 /python/pyspark/rdd.py | |
| parent | 6562787b963204763a33e1c4e9d192db913af1fc (diff) | |
| download | spark-424e987dfebbbaa37f4496d44090d469a931ce76.tar.gz spark-424e987dfebbbaa37f4496d44090d469a931ce76.tar.bz2 spark-424e987dfebbbaa37f4496d44090d469a931ce76.zip | |
[SPARK-6672][SQL] convert row to catalyst in createDataFrame(RDD[Row], ...)
We assume that `RDD[Row]` contains Scala types. So we need to convert them into catalyst types in createDataFrame. liancheng
Author: Xiangrui Meng <meng@databricks.com>
Closes #5329 from mengxr/SPARK-6672 and squashes the following commits:
2d52644 [Xiangrui Meng] set needsConversion = false in jsonRDD
06896e4 [Xiangrui Meng] add createDataFrame without conversion
4a3767b [Xiangrui Meng] convert Row to catalyst
Diffstat (limited to 'python/pyspark/rdd.py')
0 files changed, 0 insertions, 0 deletions