From 507bea5ca6d95c995f8152b8473713c136e23754 Mon Sep 17 00:00:00 2001 From: Hossein Date: Sat, 30 Apr 2016 18:11:56 -0700 Subject: [SPARK-14143] Options for parsing NaNs, Infinity and nulls for numeric types 1. Adds the following options for parsing NaNs: nanValue 2. Adds the following options for parsing infinity: positiveInf, negativeInf. `TypeCast.castTo` is unit tested and an end-to-end test is added to `CSVSuite` Author: Hossein Closes #11947 from falaki/SPARK-14143. --- sql/core/src/test/resources/numbers.csv | 9 +++++++++ 1 file changed, 9 insertions(+) create mode 100644 sql/core/src/test/resources/numbers.csv (limited to 'sql/core/src/test/resources') diff --git a/sql/core/src/test/resources/numbers.csv b/sql/core/src/test/resources/numbers.csv new file mode 100644 index 0000000000..af8feac784 --- /dev/null +++ b/sql/core/src/test/resources/numbers.csv @@ -0,0 +1,9 @@ +int,long,float,double +8,1000000,1.042,23848545.0374 +--,34232323,98.343,184721.23987223 +34,--,98.343,184721.23987223 +34,43323123,--,184721.23987223 +34,43323123,223823.9484,-- +34,43323123,223823.NAN,NAN +34,43323123,223823.INF,INF +34,43323123,223823.-INF,-INF -- cgit v1.2.3