diff options
| author | Thomas Graves <tgraves@apache.org> | 2014-08-05 15:57:32 -0500 |
|---|---|---|
| committer | Thomas Graves <tgraves@apache.org> | 2014-08-05 15:57:42 -0500 |
| commit | 7b798e10e214cd407d3399e2cab9e3789f9a929e (patch) | |
| tree | b4f616243e69825d3fc723e58c4ba854f7176805 /docs/configuration.md | |
| parent | 46b69830737cc673bfe2f9b2b9f1ced6556b1af1 (diff) | |
| download | spark-7b798e10e214cd407d3399e2cab9e3789f9a929e.tar.gz spark-7b798e10e214cd407d3399e2cab9e3789f9a929e.tar.bz2 spark-7b798e10e214cd407d3399e2cab9e3789f9a929e.zip | |
SPARK-1680: use configs for specifying environment variables on YARN
Note that this also documents spark.executorEnv.* which to me means its public. If we don't want that please speak up.
Author: Thomas Graves <tgraves@apache.org>
Closes #1512 from tgravescs/SPARK-1680 and squashes the following commits:
11525df [Thomas Graves] more doc changes
553bad0 [Thomas Graves] fix documentation
152bf7c [Thomas Graves] fix docs
5382326 [Thomas Graves] try fix docs
32f86a4 [Thomas Graves] use configs for specifying environment variables on YARN
(cherry picked from commit 41e0a21b22ccd2788dc079790788e505b0d4e37d)
Signed-off-by: Thomas Graves <tgraves@apache.org>
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 13334657a2..6ae453d09c 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -206,6 +206,14 @@ Apart from these, the following properties are also available, and may be useful used during aggregation goes above this amount, it will spill the data into disks. </td> </tr> +<tr> + <td><code>spark.executorEnv.[EnvironmentVariableName]</code></td> + <td>(none)</td> + <td> + Add the environment variable specified by <code>EnvironmentVariableName</code> to the Executor + process. The user can specify multiple of these and to set multiple environment variables. + </td> +</tr> </table> #### Shuffle Behavior |