diff options
author | Kousuke Saruta <sarutak@oss.nttdata.co.jp> | 2015-05-11 14:19:11 -0700 |
---|---|---|
committer | Sandy Ryza <sandy@cloudera.com> | 2015-05-11 14:19:11 -0700 |
commit | 6e9910c21ada19ae14122b5f14a6a30845b98229 (patch) | |
tree | dcb3d0d565c66795655b6fd10f2e043ef9cce78c | |
parent | 7ce2a33c3acffa17ae32f48ebb40b69b9b36dae4 (diff) | |
download | spark-6e9910c21ada19ae14122b5f14a6a30845b98229.tar.gz spark-6e9910c21ada19ae14122b5f14a6a30845b98229.tar.bz2 spark-6e9910c21ada19ae14122b5f14a6a30845b98229.zip |
[SPARK-7515] [DOC] Update documentation for PySpark on YARN with cluster mode
Now PySpark on YARN with cluster mode is supported so let's update doc.
Author: Kousuke Saruta <sarutak@oss.nttdata.co.jp>
Closes #6040 from sarutak/update-doc-for-pyspark-on-yarn and squashes the following commits:
ad9f88c [Kousuke Saruta] Brushed up sentences
469fd2e [Kousuke Saruta] Merge branch 'master' of https://github.com/apache/spark into update-doc-for-pyspark-on-yarn
fcfdb92 [Kousuke Saruta] Updated doc for PySpark on YARN with cluster mode
-rw-r--r-- | docs/submitting-applications.md | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/docs/submitting-applications.md b/docs/submitting-applications.md index 3ecbf2308c..e58645274e 100644 --- a/docs/submitting-applications.md +++ b/docs/submitting-applications.md @@ -59,7 +59,7 @@ for applications that involve the REPL (e.g. Spark shell). Alternatively, if your application is submitted from a machine far from the worker machines (e.g. locally on your laptop), it is common to use `cluster` mode to minimize network latency between the drivers and the executors. Note that `cluster` mode is currently not supported for -Mesos clusters or Python applications. +Mesos clusters. Currently only YARN supports cluster mode for Python applications. For Python applications, simply pass a `.py` file in the place of `<application-jar>` instead of a JAR, and add Python `.zip`, `.egg` or `.py` files to the search path with `--py-files`. |