diff options
| author | Hossein <hossein@databricks.com> | 2016-01-15 11:46:46 -0800 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-01-15 11:46:46 -0800 |
| commit | 5f83c6991c95616ecbc2878f8860c69b2826f56c (patch) | |
| tree | 86dc70e45f1b27b67efec9724632a108d69f2ef0 /sql/core/src/test/resources/comments.csv | |
| parent | c5e7076da72657ea35a0aa388f8d2e6411d39280 (diff) | |
| download | spark-5f83c6991c95616ecbc2878f8860c69b2826f56c.tar.gz spark-5f83c6991c95616ecbc2878f8860c69b2826f56c.tar.bz2 spark-5f83c6991c95616ecbc2878f8860c69b2826f56c.zip | |
[SPARK-12833][SQL] Initial import of spark-csv
CSV is the most common data format in the "small data" world. It is often the first format people want to try when they see Spark on a single node. Having to rely on a 3rd party component for this leads to poor user experience for new users. This PR merges the popular spark-csv data source package (https://github.com/databricks/spark-csv) with SparkSQL.
This is a first PR to bring the functionality to spark 2.0 master. We will complete items outlines in the design document (see JIRA attachment) in follow up pull requests.
Author: Hossein <hossein@databricks.com>
Author: Reynold Xin <rxin@databricks.com>
Closes #10766 from rxin/csv.
Diffstat (limited to 'sql/core/src/test/resources/comments.csv')
| -rw-r--r-- | sql/core/src/test/resources/comments.csv | 6 |
1 files changed, 6 insertions, 0 deletions
diff --git a/sql/core/src/test/resources/comments.csv b/sql/core/src/test/resources/comments.csv new file mode 100644 index 0000000000..6275be7285 --- /dev/null +++ b/sql/core/src/test/resources/comments.csv @@ -0,0 +1,6 @@ +~ Version 1.0 +~ Using a non-standard comment char to test CSV parser defaults are overridden +1,2,3,4,5.01,2015-08-20 15:57:00 +6,7,8,9,0,2015-08-21 16:58:01 +~0,9,8,7,6,2015-08-22 17:59:02 +1,2,3,4,5,2015-08-23 18:00:42 |