diff options
| author | Sun Rui <rui.sun@intel.com> | 2015-09-10 12:21:13 -0700 |
|---|---|---|
| committer | Shivaram Venkataraman <shivaram@cs.berkeley.edu> | 2015-09-10 12:21:13 -0700 |
| commit | 45e3be5c138d983f40f619735d60bf7eb78c9bf0 (patch) | |
| tree | 30b7b90f53eadee901a56e0e2e84222e21cf6c44 /python | |
| parent | d88abb7e212fb55f9b0398a0f76a753c86b85cf1 (diff) | |
| download | spark-45e3be5c138d983f40f619735d60bf7eb78c9bf0.tar.gz spark-45e3be5c138d983f40f619735d60bf7eb78c9bf0.tar.bz2 spark-45e3be5c138d983f40f619735d60bf7eb78c9bf0.zip | |
[SPARK-10049] [SPARKR] Support collecting data of ArraryType in DataFrame.
this PR :
1. Enhance reflection in RBackend. Automatically matching a Java array to Scala Seq when finding methods. Util functions like seq(), listToSeq() in R side can be removed, as they will conflict with the Serde logic that transferrs a Scala seq to R side.
2. Enhance the SerDe to support transferring a Scala seq to R side. Data of ArrayType in DataFrame
after collection is observed to be of Scala Seq type.
3. Support ArrayType in createDataFrame().
Author: Sun Rui <rui.sun@intel.com>
Closes #8458 from sun-rui/SPARK-10049.
Diffstat (limited to 'python')
0 files changed, 0 insertions, 0 deletions