diff options
| author | Wenchen Fan <cloud0fan@outlook.com> | 2015-08-01 00:17:15 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-08-01 00:17:15 -0700 |
| commit | 1d59a4162bf5142af270ed7f4b3eab42870c87b7 (patch) | |
| tree | 98e1c51aafb41c2c64042b30d3ddcf2205da1414 /python | |
| parent | d90f2cf7a2a1d1e69f9ab385f35f62d4091b5302 (diff) | |
| download | spark-1d59a4162bf5142af270ed7f4b3eab42870c87b7.tar.gz spark-1d59a4162bf5142af270ed7f4b3eab42870c87b7.tar.bz2 spark-1d59a4162bf5142af270ed7f4b3eab42870c87b7.zip | |
[SPARK-9480][SQL] add MapData and cleanup internal row stuff
This PR adds a `MapData` as internal representation of map type in Spark SQL, and provides a default implementation with just 2 `ArrayData`.
After that, we have specialized getters for all internal type, so I removed generic getter in `ArrayData` and added specialized `toArray` for it.
Also did some refactor and cleanup for `InternalRow` and its subclasses.
Author: Wenchen Fan <cloud0fan@outlook.com>
Closes #7799 from cloud-fan/map-data and squashes the following commits:
77d482f [Wenchen Fan] fix python
e8f6682 [Wenchen Fan] skip MapData equality check in HiveInspectorSuite
40cc9db [Wenchen Fan] add toString
6e06ec9 [Wenchen Fan] some more cleanup
a90aca1 [Wenchen Fan] add MapData
Diffstat (limited to 'python')
0 files changed, 0 insertions, 0 deletions