diff options
Diffstat (limited to 'docs/running-on-yarn.md')
| -rw-r--r-- | docs/running-on-yarn.md | 18 |
1 files changed, 17 insertions, 1 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index c775fe710f..09701abdb0 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -160,6 +160,13 @@ If you need a reference to the proper location to put log files in the YARN so t </td> </tr> <tr> + <td><code>spark.yarn.stagingDir</code></td> + <td>Current user's home directory in the filesystem</td> + <td> + Staging directory used while submitting applications. + </td> +</tr> +<tr> <td><code>spark.yarn.preserve.staging.files</code></td> <td><code>false</code></td> <td> @@ -216,6 +223,13 @@ If you need a reference to the proper location to put log files in the YARN so t </td> </tr> <tr> + <td><code>spark.yarn.dist.jars</code></td> + <td>(none)</td> + <td> + Comma-separated list of jars to be placed in the working directory of each executor. + </td> +</tr> +<tr> <td><code>spark.executor.cores</code></td> <td>1 in YARN mode, all the available cores on the worker in standalone mode.</td> <td> @@ -328,7 +342,9 @@ If you need a reference to the proper location to put log files in the YARN so t <td>(none)</td> <td> A string of extra JVM options to pass to the YARN Application Master in client mode. - In cluster mode, use <code>spark.driver.extraJavaOptions</code> instead. + In cluster mode, use <code>spark.driver.extraJavaOptions</code> instead. Note that it is illegal + to set maximum heap size (-Xmx) settings with this option. Maximum heap size settings can be set + with <code>spark.yarn.am.memory</code> </td> </tr> <tr> |