diff options
| author | Reynold Xin <rxin@databricks.com> | 2015-10-23 13:04:06 -0700 |
|---|---|---|
| committer | Yin Huai <yhuai@databricks.com> | 2015-10-23 13:04:06 -0700 |
| commit | e1a897b657eb62e837026f7b3efafb9a6424ec4f (patch) | |
| tree | 6c9553d281c65342db5ff692cbe3f4814a539eed /sql/core/src/test/resources | |
| parent | 4e38defae13b2b13e196b4d172722ef5e6266c66 (diff) | |
| download | spark-e1a897b657eb62e837026f7b3efafb9a6424ec4f.tar.gz spark-e1a897b657eb62e837026f7b3efafb9a6424ec4f.tar.bz2 spark-e1a897b657eb62e837026f7b3efafb9a6424ec4f.zip | |
[SPARK-11274] [SQL] Text data source support for Spark SQL.
This adds API for reading and writing text files, similar to SparkContext.textFile and RDD.saveAsTextFile.
```
SQLContext.read.text("/path/to/something.txt")
DataFrame.write.text("/path/to/write.txt")
```
Using the new Dataset API, this also supports
```
val ds: Dataset[String] = SQLContext.read.text("/path/to/something.txt").as[String]
```
Author: Reynold Xin <rxin@databricks.com>
Closes #9240 from rxin/SPARK-11274.
Diffstat (limited to 'sql/core/src/test/resources')
| -rw-r--r-- | sql/core/src/test/resources/text-suite.txt | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/sql/core/src/test/resources/text-suite.txt b/sql/core/src/test/resources/text-suite.txt new file mode 100644 index 0000000000..e8fd967197 --- /dev/null +++ b/sql/core/src/test/resources/text-suite.txt @@ -0,0 +1,4 @@ +This is a test file for the text data source +1+1 +数据砖头 +"doh" |