aboutsummaryrefslogtreecommitdiff
path: root/docs/running-on-yarn.md
diff options
context:
space:
mode:
authorMatei Zaharia <matei@eecs.berkeley.edu>2012-09-25 23:59:04 -0700
committerMatei Zaharia <matei@eecs.berkeley.edu>2012-09-25 23:59:04 -0700
commitd51d5e0582c0605deae7497cd95a055698dc9383 (patch)
tree6c402339d4aeae723f4985f7444a60fd0416be38 /docs/running-on-yarn.md
parentc5754bb9399a59c4a83d28e618fea87900aa8f8a (diff)
downloadspark-d51d5e0582c0605deae7497cd95a055698dc9383.tar.gz
spark-d51d5e0582c0605deae7497cd95a055698dc9383.tar.bz2
spark-d51d5e0582c0605deae7497cd95a055698dc9383.zip
Doc fixes
Diffstat (limited to 'docs/running-on-yarn.md')
-rw-r--r--docs/running-on-yarn.md28
1 files changed, 14 insertions, 14 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md
index 7cd46da940..19e7aede27 100644
--- a/docs/running-on-yarn.md
+++ b/docs/running-on-yarn.md
@@ -16,23 +16,23 @@ If you want to test out the YARN deployment mode, you can use the current spark
The command to launch the YARN Client is as follows:
- SPARK_JAR=<SPARK_YAR_FILE> ./run spark.deploy.yarn.Client
- --jar <YOUR_APP_JAR_FILE>
- --class <APP_MAIN_CLASS>
- --args <APP_MAIN_ARGUMENTS>
- --num-workers <NUMBER_OF_WORKER_MACHINES>
- --worker-memory <MEMORY_PER_WORKER>
- --worker-cores <CORES_PER_WORKER>
+ SPARK_JAR=<SPARK_YAR_FILE> ./run spark.deploy.yarn.Client \
+ --jar <YOUR_APP_JAR_FILE> \
+ --class <APP_MAIN_CLASS> \
+ --args <APP_MAIN_ARGUMENTS> \
+ --num-workers <NUMBER_OF_WORKER_MACHINES> \
+ --worker-memory <MEMORY_PER_WORKER> \
+ --worker-cores <CORES_PER_WORKER>
For example:
- SPARK_JAR=./core/target/spark-core-assembly-0.6.0-SNAPSHOT.jar ./run spark.deploy.yarn.Client
- --jar examples/target/scala-2.9.1/spark-examples_2.9.1-0.6.0-SNAPSHOT.jar
- --class spark.examples.SparkPi
- --args standalone
- --num-workers 3
- --worker-memory 2g
- --worker-cores 2
+ SPARK_JAR=./core/target/spark-core-assembly-0.6.0-SNAPSHOT.jar ./run spark.deploy.yarn.Client \
+ --jar examples/target/scala-2.9.1/spark-examples_2.9.1-0.6.0-SNAPSHOT.jar \
+ --class spark.examples.SparkPi \
+ --args standalone \
+ --num-workers 3 \
+ --worker-memory 2g \
+ --worker-cores 2
The above starts a YARN Client programs which periodically polls the Application Master for status updates and displays them in the console. The client will exit once your application has finished running.