diff options
| author | Holden Karau <holden@pigscanfly.ca> | 2014-08-30 16:58:17 -0700 |
|---|---|---|
| committer | Matei Zaharia <matei@databricks.com> | 2014-08-30 16:58:17 -0700 |
| commit | ba78383bace52b13ee931c6f2df445f721d5080a (patch) | |
| tree | a7dfe35f1158acf1910e438d0a818eed06f8e09f /python/pyspark/context.py | |
| parent | b6cf1348170951396a6a5d8a65fb670382304f5b (diff) | |
| download | spark-ba78383bace52b13ee931c6f2df445f721d5080a.tar.gz spark-ba78383bace52b13ee931c6f2df445f721d5080a.tar.bz2 spark-ba78383bace52b13ee931c6f2df445f721d5080a.zip | |
SPARK-3318: Documentation update in addFile on how to use SparkFiles.get
Rather than specifying the path to SparkFiles we need to use the filename.
Author: Holden Karau <holden@pigscanfly.ca>
Closes #2210 from holdenk/SPARK-3318-documentation-for-addfiles-should-say-to-use-file-not-path and squashes the following commits:
a25d27a [Holden Karau] Update the JavaSparkContext addFile method to be clear about using fileName with SparkFiles as well
0ebcb05 [Holden Karau] Documentation update in addFile on how to use SparkFiles.get to specify filename rather than path
Diffstat (limited to 'python/pyspark/context.py')
| -rw-r--r-- | python/pyspark/context.py | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/python/pyspark/context.py b/python/pyspark/context.py index 82f76de31a..6e4fdaa6ee 100644 --- a/python/pyspark/context.py +++ b/python/pyspark/context.py @@ -606,8 +606,8 @@ class SparkContext(object): FTP URI. To access the file in Spark jobs, use - L{SparkFiles.get(path)<pyspark.files.SparkFiles.get>} to find its - download location. + L{SparkFiles.get(fileName)<pyspark.files.SparkFiles.get>} with the + filename to find its download location. >>> from pyspark import SparkFiles >>> path = os.path.join(tempdir, "test.txt") |