diff options
author | Kalvin Chau <kalvin.chau@viasat.com> | 2017-04-06 09:14:31 +0100 |
---|---|---|
committer | Sean Owen <sowen@cloudera.com> | 2017-04-06 09:14:31 +0100 |
commit | c8fc1f3badf61bcfc4bd8eeeb61f73078ca068d1 (patch) | |
tree | 155b0488f6716f6490710c6b4130fdddc0d8bf97 /python/pyspark/sql/context.py | |
parent | e156b5dd39dc1992077fe06e0f8be810c49c8255 (diff) | |
download | spark-c8fc1f3badf61bcfc4bd8eeeb61f73078ca068d1.tar.gz spark-c8fc1f3badf61bcfc4bd8eeeb61f73078ca068d1.tar.bz2 spark-c8fc1f3badf61bcfc4bd8eeeb61f73078ca068d1.zip |
[SPARK-20085][MESOS] Configurable mesos labels for executors
## What changes were proposed in this pull request?
Add spark.mesos.task.labels configuration option to add mesos key:value labels to the executor.
"k1:v1,k2:v2" as the format, colons separating key-value and commas to list out more than one.
Discussion of labels with mgummelt at #17404
## How was this patch tested?
Added unit tests to verify labels were added correctly, with incorrect labels being ignored and added a test to test the name of the executor.
Tested with: `./build/sbt -Pmesos mesos/test`
Please review http://spark.apache.org/contributing.html before opening a pull request.
Author: Kalvin Chau <kalvin.chau@viasat.com>
Closes #17413 from kalvinnchau/mesos-labels.
Diffstat (limited to 'python/pyspark/sql/context.py')
0 files changed, 0 insertions, 0 deletions