diff options
| author | Ferdinand Xu <cheng.a.xu@intel.com> | 2016-08-30 09:15:31 -0700 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2016-08-30 09:15:31 -0700 |
| commit | 4b4e329e49f8af28fa6301bd06c48d7097eaf9e6 (patch) | |
| tree | 91ec684d78a76de75097723f82537be3e01a1c28 /yarn/src/main | |
| parent | 27209252f09ff73c58e60c6df8aaba73b308088c (diff) | |
| download | spark-4b4e329e49f8af28fa6301bd06c48d7097eaf9e6.tar.gz spark-4b4e329e49f8af28fa6301bd06c48d7097eaf9e6.tar.bz2 spark-4b4e329e49f8af28fa6301bd06c48d7097eaf9e6.zip | |
[SPARK-5682][CORE] Add encrypted shuffle in spark
This patch is using Apache Commons Crypto library to enable shuffle encryption support.
Author: Ferdinand Xu <cheng.a.xu@intel.com>
Author: kellyzly <kellyzly@126.com>
Closes #8880 from winningsix/SPARK-10771.
Diffstat (limited to 'yarn/src/main')
| -rw-r--r-- | yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala b/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala index 7fbbe91de9..2398f0aea3 100644 --- a/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala +++ b/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala @@ -1003,6 +1003,10 @@ private[spark] class Client( val securityManager = new SecurityManager(sparkConf) amContainer.setApplicationACLs( YarnSparkHadoopUtil.getApplicationAclsForYarn(securityManager).asJava) + + if (sparkConf.get(IO_ENCRYPTION_ENABLED)) { + SecurityManager.initIOEncryptionKey(sparkConf, credentials) + } setupSecurityToken(amContainer) amContainer |