diff options
| author | Hossein <hossein@databricks.com> | 2016-04-30 18:11:56 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-04-30 18:12:03 -0700 |
| commit | 507bea5ca6d95c995f8152b8473713c136e23754 (patch) | |
| tree | 663b7920df1d4fbe0ae5357a029140729a50e40b /sql/core/src/test/resources | |
| parent | 0182d9599d15f70eeb6288bf9294fa677004bd14 (diff) | |
| download | spark-507bea5ca6d95c995f8152b8473713c136e23754.tar.gz spark-507bea5ca6d95c995f8152b8473713c136e23754.tar.bz2 spark-507bea5ca6d95c995f8152b8473713c136e23754.zip | |
[SPARK-14143] Options for parsing NaNs, Infinity and nulls for numeric types
1. Adds the following options for parsing NaNs: nanValue
2. Adds the following options for parsing infinity: positiveInf, negativeInf.
`TypeCast.castTo` is unit tested and an end-to-end test is added to `CSVSuite`
Author: Hossein <hossein@databricks.com>
Closes #11947 from falaki/SPARK-14143.
Diffstat (limited to 'sql/core/src/test/resources')
| -rw-r--r-- | sql/core/src/test/resources/numbers.csv | 9 |
1 files changed, 9 insertions, 0 deletions
diff --git a/sql/core/src/test/resources/numbers.csv b/sql/core/src/test/resources/numbers.csv new file mode 100644 index 0000000000..af8feac784 --- /dev/null +++ b/sql/core/src/test/resources/numbers.csv @@ -0,0 +1,9 @@ +int,long,float,double +8,1000000,1.042,23848545.0374 +--,34232323,98.343,184721.23987223 +34,--,98.343,184721.23987223 +34,43323123,--,184721.23987223 +34,43323123,223823.9484,-- +34,43323123,223823.NAN,NAN +34,43323123,223823.INF,INF +34,43323123,223823.-INF,-INF |