diff options
| author | Thomas Graves <tgraves@apache.org> | 2014-08-05 15:57:32 -0500 |
|---|---|---|
| committer | Thomas Graves <tgraves@apache.org> | 2014-08-05 15:57:32 -0500 |
| commit | 41e0a21b22ccd2788dc079790788e505b0d4e37d (patch) | |
| tree | 2d211afa9ebaf49101b1b4de44ce47f83033d4c5 /docs/configuration.md | |
| parent | 74f82c71b03d265a7d0c98ce196ca8c44de002e8 (diff) | |
| download | spark-41e0a21b22ccd2788dc079790788e505b0d4e37d.tar.gz spark-41e0a21b22ccd2788dc079790788e505b0d4e37d.tar.bz2 spark-41e0a21b22ccd2788dc079790788e505b0d4e37d.zip | |
SPARK-1680: use configs for specifying environment variables on YARN
Note that this also documents spark.executorEnv.* which to me means its public. If we don't want that please speak up.
Author: Thomas Graves <tgraves@apache.org>
Closes #1512 from tgravescs/SPARK-1680 and squashes the following commits:
11525df [Thomas Graves] more doc changes
553bad0 [Thomas Graves] fix documentation
152bf7c [Thomas Graves] fix docs
5382326 [Thomas Graves] try fix docs
32f86a4 [Thomas Graves] use configs for specifying environment variables on YARN
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 25adea210c..5e7556c08e 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -206,6 +206,14 @@ Apart from these, the following properties are also available, and may be useful used during aggregation goes above this amount, it will spill the data into disks. </td> </tr> +<tr> + <td><code>spark.executorEnv.[EnvironmentVariableName]</code></td> + <td>(none)</td> + <td> + Add the environment variable specified by <code>EnvironmentVariableName</code> to the Executor + process. The user can specify multiple of these and to set multiple environment variables. + </td> +</tr> </table> #### Shuffle Behavior |