From bc1babd63da4ee56e6d371eb24805a5d714e8295 Mon Sep 17 00:00:00 2001 From: Shixiong Zhu Date: Fri, 22 Jan 2016 21:20:04 -0800 Subject: [SPARK-7997][CORE] Remove Akka from Spark Core and Streaming - Remove Akka dependency from core. Note: the streaming-akka project still uses Akka. - Remove HttpFileServer - Remove Akka configs from SparkConf and SSLOptions - Rename `spark.akka.frameSize` to `spark.rpc.message.maxSize`. I think it's still worth to keep this config because using `DirectTaskResult` or `IndirectTaskResult` depends on it. - Update comments and docs Author: Shixiong Zhu Closes #10854 from zsxwing/remove-akka. --- docs/security.md | 30 ++++-------------------------- 1 file changed, 4 insertions(+), 26 deletions(-) (limited to 'docs/security.md') diff --git a/docs/security.md b/docs/security.md index a4cc0f42b2..32c33d2857 100644 --- a/docs/security.md +++ b/docs/security.md @@ -27,8 +27,7 @@ If your applications are using event logging, the directory where the event logs ## Encryption -Spark supports SSL for Akka and HTTP protocols. SASL encryption is supported for the block transfer -service. +Spark supports SSL for HTTP protocols. SASL encryption is supported for the block transfer service. Encryption is not yet supported for data stored by Spark in temporary local storage, such as shuffle files, cached data, and other application files. If encrypting this data is desired, a workaround is @@ -48,10 +47,6 @@ component-specific configuration namespaces used to override the default setting Config Namespace Component - - spark.ssl.akka - Akka communication channels - spark.ssl.fs HTTP file server and broadcast server @@ -137,7 +132,7 @@ configure those ports. 7077 Submit job to cluster /
Join cluster SPARK_MASTER_PORT - Akka-based. Set to "0" to choose a port randomly. Standalone mode only. + Set to "0" to choose a port randomly. Standalone mode only. Standalone Master @@ -145,7 +140,7 @@ configure those ports. (random) Schedule executors SPARK_WORKER_PORT - Akka-based. Set to "0" to choose a port randomly. Standalone mode only. + Set to "0" to choose a port randomly. Standalone mode only. @@ -178,24 +173,7 @@ configure those ports. (random) Connect to application /
Notify executor state changes spark.driver.port - Akka-based. Set to "0" to choose a port randomly. - - - Driver - Executor - (random) - Schedule tasks - spark.executor.port - Akka-based. Set to "0" to choose a port randomly. Only used if Akka RPC backend is - configured. - - - Executor - Driver - (random) - File server for files and jars - spark.fileserver.port - Jetty-based. Only used if Akka RPC backend is configured. + Set to "0" to choose a port randomly. Executor / Driver -- cgit v1.2.3