diff options
| author | Junjie Chen <junjie.j.chen@intel.com> | 2016-11-11 10:37:58 -0800 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2016-11-11 10:37:58 -0800 |
| commit | 4f15d94cfec86130f8dab28ae2e228ded8124020 (patch) | |
| tree | 3ef2fe046d53074f27e7951103a6522718193014 /docs | |
| parent | 5ddf69470b93c0b8a28bb4ac905e7670d9c50a95 (diff) | |
| download | spark-4f15d94cfec86130f8dab28ae2e228ded8124020.tar.gz spark-4f15d94cfec86130f8dab28ae2e228ded8124020.tar.bz2 spark-4f15d94cfec86130f8dab28ae2e228ded8124020.zip | |
[SPARK-13331] AES support for over-the-wire encryption
## What changes were proposed in this pull request?
DIGEST-MD5 mechanism is used for SASL authentication and secure communication. DIGEST-MD5 mechanism supports 3DES, DES, and RC4 ciphers. However, 3DES, DES and RC4 are slow relatively.
AES provide better performance and security by design and is a replacement for 3DES according to NIST. Apache Common Crypto is a cryptographic library optimized with AES-NI, this patch employ Apache Common Crypto as enc/dec backend for SASL authentication and secure channel to improve spark RPC.
## How was this patch tested?
Unit tests and Integration test.
Author: Junjie Chen <junjie.j.chen@intel.com>
Closes #15172 from cjjnjust/shuffle_rpc_encrypt.
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/configuration.md | 26 |
1 files changed, 26 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index d0acd944dd..41c1778ee7 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -1530,6 +1530,32 @@ Apart from these, the following properties are also available, and may be useful </td> </tr> <tr> + <td><code>spark.authenticate.encryption.aes.enabled</code></td> + <td>false</td> + <td> + Enable AES for over-the-wire encryption + </td> +</tr> +<tr> + <td><code>spark.authenticate.encryption.aes.cipher.keySize</code></td> + <td>16</td> + <td> + The bytes of AES cipher key which is effective when AES cipher is enabled. AES + works with 16, 24 and 32 bytes keys. + </td> +</tr> +<tr> + <td><code>spark.authenticate.encryption.aes.cipher.class</code></td> + <td>null</td> + <td> + Specify the underlying implementation class of crypto cipher. Set null here to use default. + In order to use OpenSslCipher users should install openssl. Currently, there are two cipher + classes available in Commons Crypto library: + org.apache.commons.crypto.cipher.OpenSslCipher + org.apache.commons.crypto.cipher.JceCipher + </td> +</tr> +<tr> <td><code>spark.core.connection.ack.wait.timeout</code></td> <td>60s</td> <td> |