diff options
| author | Takeshi YAMAMURO <linguin.m.s@gmail.com> | 2017-01-26 10:15:58 +0000 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2017-01-26 10:15:58 +0000 |
| commit | 7045b8b3554459fe61c4b32868560e66444a2876 (patch) | |
| tree | 6d742d3acbeb85addec9b4cda077adaa6d7d4127 /core/src/main/scala/org | |
| parent | d3dcb63b9709a34337327be9b7d3705698716077 (diff) | |
| download | spark-7045b8b3554459fe61c4b32868560e66444a2876.tar.gz spark-7045b8b3554459fe61c4b32868560e66444a2876.tar.bz2 spark-7045b8b3554459fe61c4b32868560e66444a2876.zip | |
[CORE][DOCS] Update a help message for --files in spark-submit
## What changes were proposed in this pull request?
This pr is to update a help message for `--files` in spark-submit because it seems users get confused about how to get full paths of the files that one adds via the option.
Author: Takeshi YAMAMURO <linguin.m.s@gmail.com>
Closes #16698 from maropu/SparkFilesDoc.
Diffstat (limited to 'core/src/main/scala/org')
| -rw-r--r-- | core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala b/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala index b1d36e1821..dee77343d8 100644 --- a/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala +++ b/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala @@ -506,7 +506,8 @@ private[deploy] class SparkSubmitArguments(args: Seq[String], env: Map[String, S | --py-files PY_FILES Comma-separated list of .zip, .egg, or .py files to place | on the PYTHONPATH for Python apps. | --files FILES Comma-separated list of files to be placed in the working - | directory of each executor. + | directory of each executor. File paths of these files + | in executors can be accessed via SparkFiles.get(fileName). | | --conf PROP=VALUE Arbitrary Spark configuration property. | --properties-file FILE Path to a file from which to load extra properties. If not |