diff options
author | Reynold Xin <rxin@databricks.com> | 2015-10-23 13:04:06 -0700 |
---|---|---|
committer | Yin Huai <yhuai@databricks.com> | 2015-10-23 13:04:06 -0700 |
commit | e1a897b657eb62e837026f7b3efafb9a6424ec4f (patch) | |
tree | 6c9553d281c65342db5ff692cbe3f4814a539eed /docs/configuration.md | |
parent | 4e38defae13b2b13e196b4d172722ef5e6266c66 (diff) | |
download | spark-e1a897b657eb62e837026f7b3efafb9a6424ec4f.tar.gz spark-e1a897b657eb62e837026f7b3efafb9a6424ec4f.tar.bz2 spark-e1a897b657eb62e837026f7b3efafb9a6424ec4f.zip |
[SPARK-11274] [SQL] Text data source support for Spark SQL.
This adds API for reading and writing text files, similar to SparkContext.textFile and RDD.saveAsTextFile.
```
SQLContext.read.text("/path/to/something.txt")
DataFrame.write.text("/path/to/write.txt")
```
Using the new Dataset API, this also supports
```
val ds: Dataset[String] = SQLContext.read.text("/path/to/something.txt").as[String]
```
Author: Reynold Xin <rxin@databricks.com>
Closes #9240 from rxin/SPARK-11274.
Diffstat (limited to 'docs/configuration.md')
0 files changed, 0 insertions, 0 deletions