diff options
| author | Timothy Chen <tnachen@gmail.com> | 2015-09-04 15:21:11 -0700 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2015-09-04 15:21:31 -0700 |
| commit | b087d23e28004f1bfdf6d2cd3ff34ae58c8132df (patch) | |
| tree | 60d367ef636abcb8bb026bca494f4e111bfa0f85 /docs/running-on-mesos.md | |
| parent | 3339e6f674264e387ab6c4f9c356bd3bc7167221 (diff) | |
| download | spark-b087d23e28004f1bfdf6d2cd3ff34ae58c8132df.tar.gz spark-b087d23e28004f1bfdf6d2cd3ff34ae58c8132df.tar.bz2 spark-b087d23e28004f1bfdf6d2cd3ff34ae58c8132df.zip | |
[SPARK-9669] [MESOS] Support PySpark on Mesos cluster mode.
Support running pyspark with cluster mode on Mesos!
This doesn't upload any scripts, so if running in a remote Mesos requires the user to specify the script from a available URI.
Author: Timothy Chen <tnachen@gmail.com>
Closes #8349 from tnachen/mesos_python.
Diffstat (limited to 'docs/running-on-mesos.md')
| -rw-r--r-- | docs/running-on-mesos.md | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/docs/running-on-mesos.md b/docs/running-on-mesos.md index f36921ae30..247e6ecfbd 100644 --- a/docs/running-on-mesos.md +++ b/docs/running-on-mesos.md @@ -157,6 +157,8 @@ From the client, you can submit a job to Mesos cluster by running `spark-submit` to the url of the MesosClusterDispatcher (e.g: mesos://dispatcher:7077). You can view driver statuses on the Spark cluster Web UI. +Note that jars or python files that are passed to spark-submit should be URIs reachable by Mesos slaves. + # Mesos Run Modes Spark can run over Mesos in two modes: "fine-grained" (default) and "coarse-grained". |