diff options
| author | Ferdinand Xu <cheng.a.xu@intel.com> | 2016-08-30 09:15:31 -0700 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2016-08-30 09:15:31 -0700 |
| commit | 4b4e329e49f8af28fa6301bd06c48d7097eaf9e6 (patch) | |
| tree | 91ec684d78a76de75097723f82537be3e01a1c28 /docs | |
| parent | 27209252f09ff73c58e60c6df8aaba73b308088c (diff) | |
| download | spark-4b4e329e49f8af28fa6301bd06c48d7097eaf9e6.tar.gz spark-4b4e329e49f8af28fa6301bd06c48d7097eaf9e6.tar.bz2 spark-4b4e329e49f8af28fa6301bd06c48d7097eaf9e6.zip | |
[SPARK-5682][CORE] Add encrypted shuffle in spark
This patch is using Apache Commons Crypto library to enable shuffle encryption support.
Author: Ferdinand Xu <cheng.a.xu@intel.com>
Author: kellyzly <kellyzly@126.com>
Closes #8880 from winningsix/SPARK-10771.
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/configuration.md | 23 |
1 files changed, 23 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 2f80196105..d0c76aaad0 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -559,6 +559,29 @@ Apart from these, the following properties are also available, and may be useful <code>spark.io.compression.codec</code>. </td> </tr> +<tr> + <td><code>spark.io.encryption.enabled</code></td> + <td>false</td> + <td> + Enable IO encryption. Only supported in YARN mode. + </td> +</tr> +<tr> + <td><code>spark.io.encryption.keySizeBits</code></td> + <td>128</td> + <td> + IO encryption key size in bits. Supported values are 128, 192 and 256. + </td> +</tr> +<tr> + <td><code>spark.io.encryption.keygen.algorithm</code></td> + <td>HmacSHA1</td> + <td> + The algorithm to use when generating the IO encryption key. The supported algorithms are + described in the KeyGenerator section of the Java Cryptography Architecture Standard Algorithm + Name Documentation. + </td> +</tr> </table> #### Spark UI |