aboutsummaryrefslogtreecommitdiff
path: root/R
diff options
context:
space:
mode:
authorReynold Xin <rxin@databricks.com>2016-05-18 19:16:28 -0700
committerReynold Xin <rxin@databricks.com>2016-05-18 19:16:28 -0700
commit4987f39ac7a694e1c8b8b82246eb4fbd863201c4 (patch)
treeab3752196641559a226ec4b9a8afab5357070ac4 /R
parent9c2a376e413b0701097b0784bd725e4ca87cd837 (diff)
downloadspark-4987f39ac7a694e1c8b8b82246eb4fbd863201c4.tar.gz
spark-4987f39ac7a694e1c8b8b82246eb4fbd863201c4.tar.bz2
spark-4987f39ac7a694e1c8b8b82246eb4fbd863201c4.zip
[SPARK-14463][SQL] Document the semantics for read.text
## What changes were proposed in this pull request? This patch is a follow-up to https://github.com/apache/spark/pull/13104 and adds documentation to clarify the semantics of read.text with respect to partitioning. ## How was this patch tested? N/A Author: Reynold Xin <rxin@databricks.com> Closes #13184 from rxin/SPARK-14463.
Diffstat (limited to 'R')
-rw-r--r--R/pkg/R/SQLContext.R2
1 files changed, 2 insertions, 0 deletions
diff --git a/R/pkg/R/SQLContext.R b/R/pkg/R/SQLContext.R
index 3824e0a995..6b7a341bee 100644
--- a/R/pkg/R/SQLContext.R
+++ b/R/pkg/R/SQLContext.R
@@ -298,6 +298,8 @@ parquetFile <- function(sqlContext, ...) {
#' Create a SparkDataFrame from a text file.
#'
#' Loads a text file and returns a SparkDataFrame with a single string column named "value".
+#' If the directory structure of the text files contains partitioning information, those are
+#' ignored in the resulting DataFrame.
#' Each line in the text file is a new row in the resulting SparkDataFrame.
#'
#' @param sqlContext SQLContext to use