diff options
| author | WangTaoTheTonic <barneystinson@aliyun.com> | 2015-01-08 11:45:42 -0800 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2015-01-08 11:45:42 -0800 |
| commit | 0760787da885187b0c6dcd5c28753f0ab014d5ed (patch) | |
| tree | 5335ab4101c324d14719eb244b687e5697918442 /bin/spark-submit2.cmd | |
| parent | 0a597276dbfd921665a9f720d96e119058186aa4 (diff) | |
| download | spark-0760787da885187b0c6dcd5c28753f0ab014d5ed.tar.gz spark-0760787da885187b0c6dcd5c28753f0ab014d5ed.tar.bz2 spark-0760787da885187b0c6dcd5c28753f0ab014d5ed.zip | |
[SPARK-5130][Deploy]Take yarn-cluster as cluster mode in spark-submit
https://issues.apache.org/jira/browse/SPARK-5130
Author: WangTaoTheTonic <barneystinson@aliyun.com>
Closes #3929 from WangTaoTheTonic/SPARK-5130 and squashes the following commits:
c490648 [WangTaoTheTonic] take yarn-cluster as cluster mode in spark-submit
Diffstat (limited to 'bin/spark-submit2.cmd')
| -rw-r--r-- | bin/spark-submit2.cmd | 6 |
1 files changed, 6 insertions, 0 deletions
diff --git a/bin/spark-submit2.cmd b/bin/spark-submit2.cmd index cf6046d154..daf0284db9 100644 --- a/bin/spark-submit2.cmd +++ b/bin/spark-submit2.cmd @@ -45,11 +45,17 @@ if [%1] == [] goto continue set SPARK_SUBMIT_CLASSPATH=%2 ) else if [%1] == [--driver-java-options] ( set SPARK_SUBMIT_OPTS=%2 + ) else if [%1] == [--master] ( + set MASTER=%2 ) shift goto loop :continue +if [%MASTER%] == [yarn-cluster] ( + set SPARK_SUBMIT_DEPLOY_MODE=cluster +) + rem For client mode, the driver will be launched in the same JVM that launches rem SparkSubmit, so we may need to read the properties file for any extra class rem paths, library paths, java options and memory early on. Otherwise, it will |