aboutsummaryrefslogtreecommitdiff
path: root/docs
diff options
context:
space:
mode:
authorReynold Xin <rxin@apache.org>2013-12-14 14:16:34 -0800
committerReynold Xin <rxin@apache.org>2013-12-14 14:16:34 -0800
commit7db916596144a8b9e55fabf859d921a093d3c59f (patch)
tree98256e514bf07edc3df7aa8cc3a09d87e20d5104 /docs
parent2fd781d347107be34e6a4251b8bd0b35b351785a (diff)
parent1291dd4dceb71ca7e475511870dfa0b418f35ac5 (diff)
downloadspark-7db916596144a8b9e55fabf859d921a093d3c59f.tar.gz
spark-7db916596144a8b9e55fabf859d921a093d3c59f.tar.bz2
spark-7db916596144a8b9e55fabf859d921a093d3c59f.zip
Merge pull request #251 from pwendell/master
Fix list rendering in YARN markdown docs. This is some minor clean-up which makes the list render correctly.
Diffstat (limited to 'docs')
-rw-r--r--docs/running-on-yarn.md12
1 files changed, 7 insertions, 5 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md
index 9e4c4e123f..aa75ca4324 100644
--- a/docs/running-on-yarn.md
+++ b/docs/running-on-yarn.md
@@ -32,14 +32,16 @@ If you want to test out the YARN deployment mode, you can use the current Spark
Most of the configs are the same for Spark on YARN as other deploys. See the Configuration page for more information on those. These are configs that are specific to SPARK on YARN.
Environment variables:
+
* `SPARK_YARN_USER_ENV`, to add environment variables to the Spark processes launched on YARN. This can be a comma separated list of environment variables, e.g. `SPARK_YARN_USER_ENV="JAVA_HOME=/jdk64,FOO=bar"`.
System Properties:
-* 'spark.yarn.applicationMaster.waitTries', property to set the number of times the ApplicationMaster waits for the the spark master and then also the number of tries it waits for the Spark Context to be intialized. Default is 10.
-* 'spark.yarn.submit.file.replication', the HDFS replication level for the files uploaded into HDFS for the application. These include things like the spark jar, the app jar, and any distributed cache files/archives.
-* 'spark.yarn.preserve.staging.files', set to true to preserve the staged files(spark jar, app jar, distributed cache files) at the end of the job rather then delete them.
-* 'spark.yarn.scheduler.heartbeat.interval-ms', the interval in ms in which the Spark application master heartbeats into the YARN ResourceManager. Default is 5 seconds.
-* 'spark.yarn.max.worker.failures', the maximum number of worker failures before failing the application. Default is the number of workers requested times 2 with minimum of 3.
+
+* `spark.yarn.applicationMaster.waitTries`, property to set the number of times the ApplicationMaster waits for the the spark master and then also the number of tries it waits for the Spark Context to be intialized. Default is 10.
+* `spark.yarn.submit.file.replication`, the HDFS replication level for the files uploaded into HDFS for the application. These include things like the spark jar, the app jar, and any distributed cache files/archives.
+* `spark.yarn.preserve.staging.files`, set to true to preserve the staged files(spark jar, app jar, distributed cache files) at the end of the job rather then delete them.
+* `spark.yarn.scheduler.heartbeat.interval-ms`, the interval in ms in which the Spark application master heartbeats into the YARN ResourceManager. Default is 5 seconds.
+* `spark.yarn.max.worker.failures`, the maximum number of worker failures before failing the application. Default is the number of workers requested times 2 with minimum of 3.
# Launching Spark on YARN