diff options
| author | Marcelo Vanzin <vanzin@cloudera.com> | 2015-12-10 13:26:30 -0800 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2015-12-10 13:26:30 -0800 |
| commit | 4a46b8859d3314b5b45a67cdc5c81fecb6e9e78c (patch) | |
| tree | e675378fe850f9fbcf2cafea7cae589876f147a8 /docs | |
| parent | 2ecbe02d5b28ee562d10c1735244b90a08532c9e (diff) | |
| download | spark-4a46b8859d3314b5b45a67cdc5c81fecb6e9e78c.tar.gz spark-4a46b8859d3314b5b45a67cdc5c81fecb6e9e78c.tar.bz2 spark-4a46b8859d3314b5b45a67cdc5c81fecb6e9e78c.zip | |
[SPARK-11563][CORE][REPL] Use RpcEnv to transfer REPL-generated classes.
This avoids bringing up yet another HTTP server on the driver, and
instead reuses the file server already managed by the driver's
RpcEnv. As a bonus, the repl now inherits the security features of
the network library.
There's also a small change to create the directory for storing classes
under the root temp dir for the application (instead of directly
under java.io.tmpdir).
Author: Marcelo Vanzin <vanzin@cloudera.com>
Closes #9923 from vanzin/SPARK-11563.
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/configuration.md | 8 | ||||
| -rw-r--r-- | docs/security.md | 8 |
2 files changed, 0 insertions, 16 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index fd61ddc244..873a2d0b30 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -1054,14 +1054,6 @@ Apart from these, the following properties are also available, and may be useful </td> </tr> <tr> - <td><code>spark.replClassServer.port</code></td> - <td>(random)</td> - <td> - Port for the driver's HTTP class server to listen on. - This is only relevant for the Spark shell. - </td> -</tr> -<tr> <td><code>spark.rpc.numRetries</code></td> <td>3</td> <td> diff --git a/docs/security.md b/docs/security.md index e1af221d44..0bfc791c57 100644 --- a/docs/security.md +++ b/docs/security.md @@ -170,14 +170,6 @@ configure those ports. instead.</td> </tr> <tr> - <td>Executor</td> - <td>Driver</td> - <td>(random)</td> - <td>Class file server</td> - <td><code>spark.replClassServer.port</code></td> - <td>Jetty-based. Only used in Spark shells.</td> - </tr> - <tr> <td>Executor / Driver</td> <td>Executor / Driver</td> <td>(random)</td> |