diff options
author | Sean Owen <sowen@cloudera.com> | 2015-03-11 14:09:09 +0000 |
---|---|---|
committer | Sean Owen <sowen@cloudera.com> | 2015-03-11 14:09:09 +0000 |
commit | 55c4831d68c8326380086b5540244f984ea9ec27 (patch) | |
tree | ff47be6ab3d9bc3a9b5039e1d183f0d7e9c2512f /examples | |
parent | 2d87a415f20c85487537d6791a73827ff537f2c0 (diff) | |
download | spark-55c4831d68c8326380086b5540244f984ea9ec27.tar.gz spark-55c4831d68c8326380086b5540244f984ea9ec27.tar.bz2 spark-55c4831d68c8326380086b5540244f984ea9ec27.zip |
SPARK-6245 [SQL] jsonRDD() of empty RDD results in exception
Avoid `UnsupportedOperationException` from JsonRDD.inferSchema on empty RDD.
Not sure if this is supposed to be an error (but a better one), but it seems like this case can come up if the input is down-sampled so much that nothing is sampled.
Now stuff like this:
```
sqlContext.jsonRDD(sc.parallelize(List[String]()))
```
just results in
```
org.apache.spark.sql.DataFrame = []
```
Author: Sean Owen <sowen@cloudera.com>
Closes #4971 from srowen/SPARK-6245 and squashes the following commits:
3699964 [Sean Owen] Set() -> Set.empty
3c619e1 [Sean Owen] Avoid UnsupportedOperationException from JsonRDD.inferSchema on empty RDD
Diffstat (limited to 'examples')
0 files changed, 0 insertions, 0 deletions