diff options
| author | tianyi <tianyi.asiainfo@gmail.com> | 2015-02-12 22:18:39 -0800 |
|---|---|---|
| committer | Cheng Lian <lian@databricks.com> | 2015-02-12 22:18:39 -0800 |
| commit | 1c8633f3fe9d814c83384e339b958740c250c00c (patch) | |
| tree | 9f4a9fb4c2f7757a552423deed8f7cb37246e910 /sbin/spark-daemon.sh | |
| parent | 2aea892ebd4d6c802defeef35ef7ebfe42c06eba (diff) | |
| download | spark-1c8633f3fe9d814c83384e339b958740c250c00c.tar.gz spark-1c8633f3fe9d814c83384e339b958740c250c00c.tar.bz2 spark-1c8633f3fe9d814c83384e339b958740c250c00c.zip | |
[SPARK-3365][SQL]Wrong schema generated for List type
This PR fix the issue SPARK-3365.
The reason is Spark generated wrong schema for the type `List` in `ScalaReflection.scala`
for example:
the generated schema for type `Seq[String]` is:
```
{"name":"x","type":{"type":"array","elementType":"string","containsNull":true},"nullable":true,"metadata":{}}`
```
the generated schema for type `List[String]` is:
```
{"name":"x","type":{"type":"struct","fields":[]},"nullable":true,"metadata":{}}`
```
Author: tianyi <tianyi.asiainfo@gmail.com>
Closes #4581 from tianyi/SPARK-3365 and squashes the following commits:
a097e86 [tianyi] change the order of resolution in ScalaReflection.scala
Diffstat (limited to 'sbin/spark-daemon.sh')
0 files changed, 0 insertions, 0 deletions