diff options
| author | jerryshao <sshao@hortonworks.com> | 2015-11-23 10:41:17 -0800 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2015-11-23 10:41:17 -0800 |
| commit | 5fd86e4fc2e06d2403ca538ae417580c93b69e06 (patch) | |
| tree | b6daea5f6d8da1ccc293e3cafff00ea6efd5d8e3 /docs/running-on-yarn.md | |
| parent | 946b406519af58c79041217e6f93854b6cf80acd (diff) | |
| download | spark-5fd86e4fc2e06d2403ca538ae417580c93b69e06.tar.gz spark-5fd86e4fc2e06d2403ca538ae417580c93b69e06.tar.bz2 spark-5fd86e4fc2e06d2403ca538ae417580c93b69e06.zip | |
[SPARK-7173][YARN] Add label expression support for application master
Add label expression support for AM to restrict it runs on the specific set of nodes. I tested it locally and works fine.
sryza and vanzin please help to review, thanks a lot.
Author: jerryshao <sshao@hortonworks.com>
Closes #9800 from jerryshao/SPARK-7173.
Diffstat (limited to 'docs/running-on-yarn.md')
| -rw-r--r-- | docs/running-on-yarn.md | 9 |
1 files changed, 9 insertions, 0 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index db6bfa69ee..925a1e0ba6 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -327,6 +327,15 @@ If you need a reference to the proper location to put log files in the YARN so t </td> </tr> <tr> + <td><code>spark.yarn.am.nodeLabelExpression</code></td> + <td>(none)</td> + <td> + A YARN node label expression that restricts the set of nodes AM will be scheduled on. + Only versions of YARN greater than or equal to 2.6 support node label expressions, so when + running against earlier versions, this property will be ignored. + </td> +</tr> +<tr> <td><code>spark.yarn.executor.nodeLabelExpression</code></td> <td>(none)</td> <td> |