diff options
| author | Reynold Xin <rxin@databricks.com> | 2015-10-23 13:04:06 -0700 |
|---|---|---|
| committer | Yin Huai <yhuai@databricks.com> | 2015-10-23 13:04:06 -0700 |
| commit | e1a897b657eb62e837026f7b3efafb9a6424ec4f (patch) | |
| tree | 6c9553d281c65342db5ff692cbe3f4814a539eed /sql/core/src/main/resources/META-INF/services/org.apache.spark.sql.sources.DataSourceRegister | |
| parent | 4e38defae13b2b13e196b4d172722ef5e6266c66 (diff) | |
| download | spark-e1a897b657eb62e837026f7b3efafb9a6424ec4f.tar.gz spark-e1a897b657eb62e837026f7b3efafb9a6424ec4f.tar.bz2 spark-e1a897b657eb62e837026f7b3efafb9a6424ec4f.zip | |
[SPARK-11274] [SQL] Text data source support for Spark SQL.
This adds API for reading and writing text files, similar to SparkContext.textFile and RDD.saveAsTextFile.
```
SQLContext.read.text("/path/to/something.txt")
DataFrame.write.text("/path/to/write.txt")
```
Using the new Dataset API, this also supports
```
val ds: Dataset[String] = SQLContext.read.text("/path/to/something.txt").as[String]
```
Author: Reynold Xin <rxin@databricks.com>
Closes #9240 from rxin/SPARK-11274.
Diffstat (limited to 'sql/core/src/main/resources/META-INF/services/org.apache.spark.sql.sources.DataSourceRegister')
| -rw-r--r-- | sql/core/src/main/resources/META-INF/services/org.apache.spark.sql.sources.DataSourceRegister | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/sql/core/src/main/resources/META-INF/services/org.apache.spark.sql.sources.DataSourceRegister b/sql/core/src/main/resources/META-INF/services/org.apache.spark.sql.sources.DataSourceRegister index ca50000b47..1ca2044057 100644 --- a/sql/core/src/main/resources/META-INF/services/org.apache.spark.sql.sources.DataSourceRegister +++ b/sql/core/src/main/resources/META-INF/services/org.apache.spark.sql.sources.DataSourceRegister @@ -1,3 +1,4 @@ org.apache.spark.sql.execution.datasources.jdbc.DefaultSource org.apache.spark.sql.execution.datasources.json.DefaultSource org.apache.spark.sql.execution.datasources.parquet.DefaultSource +org.apache.spark.sql.execution.datasources.text.DefaultSource |