diff options
| author | Y.CORP.YAHOO.COM\tgraves <tgraves@thatenemy-lm.champ.corp.yahoo.com> | 2013-08-30 15:55:32 -0500 |
|---|---|---|
| committer | Y.CORP.YAHOO.COM\tgraves <tgraves@thatenemy-lm.champ.corp.yahoo.com> | 2013-08-30 15:55:32 -0500 |
| commit | bac46266a97a6096d6d772e023a3362fd48baac0 (patch) | |
| tree | 26ec4fc4098b3c34a9277731c6cd7e3769b9b1e2 /docs/running-on-yarn.md | |
| parent | 94bb7fd46e5586e1d08a99d21eecef93eeb4b97c (diff) | |
| download | spark-bac46266a97a6096d6d772e023a3362fd48baac0.tar.gz spark-bac46266a97a6096d6d772e023a3362fd48baac0.tar.bz2 spark-bac46266a97a6096d6d772e023a3362fd48baac0.zip | |
Link the Spark UI to the Yarn UI
Diffstat (limited to 'docs/running-on-yarn.md')
| -rw-r--r-- | docs/running-on-yarn.md | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 678cd57aba..3f0d077f71 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -46,8 +46,12 @@ If you want to test out the YARN deployment mode, you can use the current Spark Most of the configs are the same for Spark on YARN as other deploys. See the Configuration page for more information on those. These are configs that are specific to SPARK on YARN. +Environment variables: * `SPARK_YARN_USER_ENV`, to add environment variables to the Spark processes launched on YARN. This can be a comma separated list of environment variables. ie SPARK_YARN_USER_ENV="JAVA_HOME=/jdk64,FOO=bar" +Properties: +* 'spark.yarn.applicationMaster.waitTries', property to set the number of times the ApplicationMaster waits for the the spark master and then also the number of tries it waits for the Spark Context to be intialized. Default is 10. + # Launching Spark on YARN Ensure that HADOOP_CONF_DIR or YARN_CONF_DIR points to the directory which contains the (client side) configuration files for the hadoop cluster. |