diff options
| author | Shixiong Zhu <shixiong@databricks.com> | 2016-01-22 21:20:04 -0800 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-01-22 21:20:04 -0800 |
| commit | bc1babd63da4ee56e6d371eb24805a5d714e8295 (patch) | |
| tree | 8aec6a20e3d23574f53d818752df61a28c64d635 /docs/security.md | |
| parent | d8fefab4d8149f0638282570c75271ef35c65cff (diff) | |
| download | spark-bc1babd63da4ee56e6d371eb24805a5d714e8295.tar.gz spark-bc1babd63da4ee56e6d371eb24805a5d714e8295.tar.bz2 spark-bc1babd63da4ee56e6d371eb24805a5d714e8295.zip | |
[SPARK-7997][CORE] Remove Akka from Spark Core and Streaming
- Remove Akka dependency from core. Note: the streaming-akka project still uses Akka.
- Remove HttpFileServer
- Remove Akka configs from SparkConf and SSLOptions
- Rename `spark.akka.frameSize` to `spark.rpc.message.maxSize`. I think it's still worth to keep this config because using `DirectTaskResult` or `IndirectTaskResult` depends on it.
- Update comments and docs
Author: Shixiong Zhu <shixiong@databricks.com>
Closes #10854 from zsxwing/remove-akka.
Diffstat (limited to 'docs/security.md')
| -rw-r--r-- | docs/security.md | 30 |
1 files changed, 4 insertions, 26 deletions
diff --git a/docs/security.md b/docs/security.md index a4cc0f42b2..32c33d2857 100644 --- a/docs/security.md +++ b/docs/security.md @@ -27,8 +27,7 @@ If your applications are using event logging, the directory where the event logs ## Encryption -Spark supports SSL for Akka and HTTP protocols. SASL encryption is supported for the block transfer -service. +Spark supports SSL for HTTP protocols. SASL encryption is supported for the block transfer service. Encryption is not yet supported for data stored by Spark in temporary local storage, such as shuffle files, cached data, and other application files. If encrypting this data is desired, a workaround is @@ -49,10 +48,6 @@ component-specific configuration namespaces used to override the default setting <th>Component</th> </tr> <tr> - <td><code>spark.ssl.akka</code></td> - <td>Akka communication channels</td> - </tr> - <tr> <td><code>spark.ssl.fs</code></td> <td>HTTP file server and broadcast server</td> </tr> @@ -137,7 +132,7 @@ configure those ports. <td>7077</td> <td>Submit job to cluster /<br> Join cluster</td> <td><code>SPARK_MASTER_PORT</code></td> - <td>Akka-based. Set to "0" to choose a port randomly. Standalone mode only.</td> + <td>Set to "0" to choose a port randomly. Standalone mode only.</td> </tr> <tr> <td>Standalone Master</td> @@ -145,7 +140,7 @@ configure those ports. <td>(random)</td> <td>Schedule executors</td> <td><code>SPARK_WORKER_PORT</code></td> - <td>Akka-based. Set to "0" to choose a port randomly. Standalone mode only.</td> + <td>Set to "0" to choose a port randomly. Standalone mode only.</td> </tr> </table> @@ -178,24 +173,7 @@ configure those ports. <td>(random)</td> <td>Connect to application /<br> Notify executor state changes</td> <td><code>spark.driver.port</code></td> - <td>Akka-based. Set to "0" to choose a port randomly.</td> - </tr> - <tr> - <td>Driver</td> - <td>Executor</td> - <td>(random)</td> - <td>Schedule tasks</td> - <td><code>spark.executor.port</code></td> - <td>Akka-based. Set to "0" to choose a port randomly. Only used if Akka RPC backend is - configured.</td> - </tr> - <tr> - <td>Executor</td> - <td>Driver</td> - <td>(random)</td> - <td>File server for files and jars</td> - <td><code>spark.fileserver.port</code></td> - <td>Jetty-based. Only used if Akka RPC backend is configured.</td> + <td>Set to "0" to choose a port randomly.</td> </tr> <tr> <td>Executor / Driver</td> |