diff options
| author | Jason Lee <cjlee@us.ibm.com> | 2016-01-27 09:55:10 -0800 |
|---|---|---|
| committer | Yin Huai <yhuai@databricks.com> | 2016-01-27 09:55:10 -0800 |
| commit | edd473751b59b55fa3daede5ed7bc19ea8bd7170 (patch) | |
| tree | f05e166a4fd9959182f72a66a15f6118684c9468 /project | |
| parent | 41f0c85f9be264103c066935e743f59caf0fe268 (diff) | |
| download | spark-edd473751b59b55fa3daede5ed7bc19ea8bd7170.tar.gz spark-edd473751b59b55fa3daede5ed7bc19ea8bd7170.tar.bz2 spark-edd473751b59b55fa3daede5ed7bc19ea8bd7170.zip | |
[SPARK-10847][SQL][PYSPARK] Pyspark - DataFrame - Optional Metadata with `None` triggers cryptic failure
The error message is now changed from "Do not support type class scala.Tuple2." to "Do not support type class org.json4s.JsonAST$JNull$" to be more informative about what is not supported. Also, StructType metadata now handles JNull correctly, i.e., {'a': None}. test_metadata_null is added to tests.py to show the fix works.
Author: Jason Lee <cjlee@us.ibm.com>
Closes #8969 from jasoncl/SPARK-10847.
Diffstat (limited to 'project')
0 files changed, 0 insertions, 0 deletions