diff options
author | Wenchen Fan <cloud0fan@outlook.com> | 2015-08-01 00:17:15 -0700 |
---|---|---|
committer | Reynold Xin <rxin@databricks.com> | 2015-08-01 00:17:15 -0700 |
commit | 1d59a4162bf5142af270ed7f4b3eab42870c87b7 (patch) | |
tree | 98e1c51aafb41c2c64042b30d3ddcf2205da1414 /assembly/pom.xml | |
parent | d90f2cf7a2a1d1e69f9ab385f35f62d4091b5302 (diff) | |
download | spark-1d59a4162bf5142af270ed7f4b3eab42870c87b7.tar.gz spark-1d59a4162bf5142af270ed7f4b3eab42870c87b7.tar.bz2 spark-1d59a4162bf5142af270ed7f4b3eab42870c87b7.zip |
[SPARK-9480][SQL] add MapData and cleanup internal row stuff
This PR adds a `MapData` as internal representation of map type in Spark SQL, and provides a default implementation with just 2 `ArrayData`.
After that, we have specialized getters for all internal type, so I removed generic getter in `ArrayData` and added specialized `toArray` for it.
Also did some refactor and cleanup for `InternalRow` and its subclasses.
Author: Wenchen Fan <cloud0fan@outlook.com>
Closes #7799 from cloud-fan/map-data and squashes the following commits:
77d482f [Wenchen Fan] fix python
e8f6682 [Wenchen Fan] skip MapData equality check in HiveInspectorSuite
40cc9db [Wenchen Fan] add toString
6e06ec9 [Wenchen Fan] some more cleanup
a90aca1 [Wenchen Fan] add MapData
Diffstat (limited to 'assembly/pom.xml')
0 files changed, 0 insertions, 0 deletions