diff options
| author | Kalvin Chau <kalvin.chau@viasat.com> | 2017-04-06 09:14:31 +0100 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2017-04-06 09:14:31 +0100 |
| commit | c8fc1f3badf61bcfc4bd8eeeb61f73078ca068d1 (patch) | |
| tree | 155b0488f6716f6490710c6b4130fdddc0d8bf97 /docs/running-on-mesos.md | |
| parent | e156b5dd39dc1992077fe06e0f8be810c49c8255 (diff) | |
| download | spark-c8fc1f3badf61bcfc4bd8eeeb61f73078ca068d1.tar.gz spark-c8fc1f3badf61bcfc4bd8eeeb61f73078ca068d1.tar.bz2 spark-c8fc1f3badf61bcfc4bd8eeeb61f73078ca068d1.zip | |
[SPARK-20085][MESOS] Configurable mesos labels for executors
## What changes were proposed in this pull request?
Add spark.mesos.task.labels configuration option to add mesos key:value labels to the executor.
"k1:v1,k2:v2" as the format, colons separating key-value and commas to list out more than one.
Discussion of labels with mgummelt at #17404
## How was this patch tested?
Added unit tests to verify labels were added correctly, with incorrect labels being ignored and added a test to test the name of the executor.
Tested with: `./build/sbt -Pmesos mesos/test`
Please review http://spark.apache.org/contributing.html before opening a pull request.
Author: Kalvin Chau <kalvin.chau@viasat.com>
Closes #17413 from kalvinnchau/mesos-labels.
Diffstat (limited to 'docs/running-on-mesos.md')
| -rw-r--r-- | docs/running-on-mesos.md | 9 |
1 files changed, 9 insertions, 0 deletions
diff --git a/docs/running-on-mesos.md b/docs/running-on-mesos.md index 8d5ad12cb8..ef01cfe4b9 100644 --- a/docs/running-on-mesos.md +++ b/docs/running-on-mesos.md @@ -368,6 +368,15 @@ See the [configuration page](configuration.html) for information on Spark config </td> </tr> <tr> + <td><code>spark.mesos.task.labels</code></td> + <td>(none)</td> + <td> + Set the Mesos labels to add to each task. Labels are free-form key-value pairs. + Key-value pairs should be separated by a colon, and commas used to list more than one. + Ex. key:value,key2:value2. + </td> +</tr> +<tr> <td><code>spark.mesos.executor.home</code></td> <td>driver side <code>SPARK_HOME</code></td> <td> |