diff options
| author | Holden Karau <holden@us.ibm.com> | 2015-12-30 11:14:47 -0800 |
|---|---|---|
| committer | Davies Liu <davies.liu@gmail.com> | 2015-12-30 11:14:47 -0800 |
| commit | d1ca634db4ca9db7f0ba7ca38a0e03bcbfec23c9 (patch) | |
| tree | 14988ffcfe92aa04d851112c1ddf22ad8d11f153 /pom.xml | |
| parent | aa48164a43bd9ed9eab53fcacbed92819e84eaf7 (diff) | |
| download | spark-d1ca634db4ca9db7f0ba7ca38a0e03bcbfec23c9.tar.gz spark-d1ca634db4ca9db7f0ba7ca38a0e03bcbfec23c9.tar.bz2 spark-d1ca634db4ca9db7f0ba7ca38a0e03bcbfec23c9.zip | |
[SPARK-12300] [SQL] [PYSPARK] fix schema inferance on local collections
Current schema inference for local python collections halts as soon as there are no NullTypes. This is different than when we specify a sampling ratio of 1.0 on a distributed collection. This could result in incomplete schema information.
Author: Holden Karau <holden@us.ibm.com>
Closes #10275 from holdenk/SPARK-12300-fix-schmea-inferance-on-local-collections.
Diffstat (limited to 'pom.xml')
0 files changed, 0 insertions, 0 deletions