diff options
| author | Reynold Xin <rxin@databricks.com> | 2015-12-30 18:07:07 -0800 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-12-30 18:07:07 -0800 |
| commit | ee8f8d318417c514fbb26e57157483d466ddbfae (patch) | |
| tree | 7da3d291a1014f63789679f8a22c726ece3634de /docs/security.md | |
| parent | f76ee109d87e727710d2721e4be47fdabc21582c (diff) | |
| download | spark-ee8f8d318417c514fbb26e57157483d466ddbfae.tar.gz spark-ee8f8d318417c514fbb26e57157483d466ddbfae.tar.bz2 spark-ee8f8d318417c514fbb26e57157483d466ddbfae.zip | |
[SPARK-12588] Remove HttpBroadcast in Spark 2.0.
We switched to TorrentBroadcast in Spark 1.1, and HttpBroadcast has been undocumented since then. It's time to remove it in Spark 2.0.
Author: Reynold Xin <rxin@databricks.com>
Closes #10531 from rxin/SPARK-12588.
Diffstat (limited to 'docs/security.md')
| -rw-r--r-- | docs/security.md | 13 |
1 files changed, 2 insertions, 11 deletions
diff --git a/docs/security.md b/docs/security.md index 0bfc791c57..1b7741d4dd 100644 --- a/docs/security.md +++ b/docs/security.md @@ -23,7 +23,7 @@ If your applications are using event logging, the directory where the event logs ## Encryption -Spark supports SSL for Akka and HTTP (for broadcast and file server) protocols. SASL encryption is +Spark supports SSL for Akka and HTTP (for file server) protocols. SASL encryption is supported for the block transfer service. Encryption is not yet supported for the WebUI. Encryption is not yet supported for data stored by Spark in temporary local storage, such as shuffle @@ -32,7 +32,7 @@ to configure your cluster manager to store application data on encrypted disks. ### SSL Configuration -Configuration for SSL is organized hierarchically. The user can configure the default SSL settings which will be used for all the supported communication protocols unless they are overwritten by protocol-specific settings. This way the user can easily provide the common settings for all the protocols without disabling the ability to configure each one individually. The common SSL settings are at `spark.ssl` namespace in Spark configuration, while Akka SSL configuration is at `spark.ssl.akka` and HTTP for broadcast and file server SSL configuration is at `spark.ssl.fs`. The full breakdown can be found on the [configuration page](configuration.html). +Configuration for SSL is organized hierarchically. The user can configure the default SSL settings which will be used for all the supported communication protocols unless they are overwritten by protocol-specific settings. This way the user can easily provide the common settings for all the protocols without disabling the ability to configure each one individually. The common SSL settings are at `spark.ssl` namespace in Spark configuration, while Akka SSL configuration is at `spark.ssl.akka` and HTTP for file server SSL configuration is at `spark.ssl.fs`. The full breakdown can be found on the [configuration page](configuration.html). SSL must be configured on each node and configured for each component involved in communication using the particular protocol. @@ -161,15 +161,6 @@ configure those ports. <td>Jetty-based. Only used if Akka RPC backend is configured.</td> </tr> <tr> - <td>Executor</td> - <td>Driver</td> - <td>(random)</td> - <td>HTTP Broadcast</td> - <td><code>spark.broadcast.port</code></td> - <td>Jetty-based. Not used by TorrentBroadcast, which sends data through the block manager - instead.</td> - </tr> - <tr> <td>Executor / Driver</td> <td>Executor / Driver</td> <td>(random)</td> |