diff options
| author | Hossein <hossein@databricks.com> | 2016-01-15 11:46:46 -0800 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-01-15 11:46:46 -0800 |
| commit | 5f83c6991c95616ecbc2878f8860c69b2826f56c (patch) | |
| tree | 86dc70e45f1b27b67efec9724632a108d69f2ef0 /dev | |
| parent | c5e7076da72657ea35a0aa388f8d2e6411d39280 (diff) | |
| download | spark-5f83c6991c95616ecbc2878f8860c69b2826f56c.tar.gz spark-5f83c6991c95616ecbc2878f8860c69b2826f56c.tar.bz2 spark-5f83c6991c95616ecbc2878f8860c69b2826f56c.zip | |
[SPARK-12833][SQL] Initial import of spark-csv
CSV is the most common data format in the "small data" world. It is often the first format people want to try when they see Spark on a single node. Having to rely on a 3rd party component for this leads to poor user experience for new users. This PR merges the popular spark-csv data source package (https://github.com/databricks/spark-csv) with SparkSQL.
This is a first PR to bring the functionality to spark 2.0 master. We will complete items outlines in the design document (see JIRA attachment) in follow up pull requests.
Author: Hossein <hossein@databricks.com>
Author: Reynold Xin <rxin@databricks.com>
Closes #10766 from rxin/csv.
Diffstat (limited to 'dev')
| -rw-r--r-- | dev/deps/spark-deps-hadoop-2.2 | 1 | ||||
| -rw-r--r-- | dev/deps/spark-deps-hadoop-2.3 | 1 | ||||
| -rw-r--r-- | dev/deps/spark-deps-hadoop-2.4 | 1 | ||||
| -rw-r--r-- | dev/deps/spark-deps-hadoop-2.6 | 1 |
4 files changed, 4 insertions, 0 deletions
diff --git a/dev/deps/spark-deps-hadoop-2.2 b/dev/deps/spark-deps-hadoop-2.2 index 53034a25d4..fb2e91e1ee 100644 --- a/dev/deps/spark-deps-hadoop-2.2 +++ b/dev/deps/spark-deps-hadoop-2.2 @@ -184,6 +184,7 @@ tachyon-underfs-hdfs-0.8.2.jar tachyon-underfs-local-0.8.2.jar tachyon-underfs-s3-0.8.2.jar uncommons-maths-1.2.2a.jar +univocity-parsers-1.5.6.jar unused-1.0.0.jar xbean-asm5-shaded-4.4.jar xmlenc-0.52.jar diff --git a/dev/deps/spark-deps-hadoop-2.3 b/dev/deps/spark-deps-hadoop-2.3 index a23e260641..59e4d4f839 100644 --- a/dev/deps/spark-deps-hadoop-2.3 +++ b/dev/deps/spark-deps-hadoop-2.3 @@ -175,6 +175,7 @@ tachyon-underfs-hdfs-0.8.2.jar tachyon-underfs-local-0.8.2.jar tachyon-underfs-s3-0.8.2.jar uncommons-maths-1.2.2a.jar +univocity-parsers-1.5.6.jar unused-1.0.0.jar xbean-asm5-shaded-4.4.jar xmlenc-0.52.jar diff --git a/dev/deps/spark-deps-hadoop-2.4 b/dev/deps/spark-deps-hadoop-2.4 index 6bedbed1e3..e4395c872c 100644 --- a/dev/deps/spark-deps-hadoop-2.4 +++ b/dev/deps/spark-deps-hadoop-2.4 @@ -176,6 +176,7 @@ tachyon-underfs-hdfs-0.8.2.jar tachyon-underfs-local-0.8.2.jar tachyon-underfs-s3-0.8.2.jar uncommons-maths-1.2.2a.jar +univocity-parsers-1.5.6.jar unused-1.0.0.jar xbean-asm5-shaded-4.4.jar xmlenc-0.52.jar diff --git a/dev/deps/spark-deps-hadoop-2.6 b/dev/deps/spark-deps-hadoop-2.6 index 7bfad57b4a..89fd15da7d 100644 --- a/dev/deps/spark-deps-hadoop-2.6 +++ b/dev/deps/spark-deps-hadoop-2.6 @@ -182,6 +182,7 @@ tachyon-underfs-hdfs-0.8.2.jar tachyon-underfs-local-0.8.2.jar tachyon-underfs-s3-0.8.2.jar uncommons-maths-1.2.2a.jar +univocity-parsers-1.5.6.jar unused-1.0.0.jar xbean-asm5-shaded-4.4.jar xercesImpl-2.9.1.jar |