diff options
| author | wm624@hotmail.com <wm624@hotmail.com> | 2016-08-21 11:51:46 +0100 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2016-08-21 11:51:46 +0100 |
| commit | e328f577e81363f6b3f892931f20dbf68f7d29cf (patch) | |
| tree | 09a80b5c2781fba98009236e50a2e061f61239b0 /docs | |
| parent | 7f08a60b6e9acb89482fa0e268b192250d9ba6e4 (diff) | |
| download | spark-e328f577e81363f6b3f892931f20dbf68f7d29cf.tar.gz spark-e328f577e81363f6b3f892931f20dbf68f7d29cf.tar.bz2 spark-e328f577e81363f6b3f892931f20dbf68f7d29cf.zip | |
[SPARK-17002][CORE] Document that spark.ssl.protocol. is required for SSL
## What changes were proposed in this pull request?
`spark.ssl.enabled`=true, but failing to set `spark.ssl.protocol` will fail and throw meaningless exception. `spark.ssl.protocol` is required when `spark.ssl.enabled`.
Improvement: require `spark.ssl.protocol` when initializing SSLContext, otherwise throws an exception to indicate that.
Remove the OrElse("default").
Document this requirement in configure.md
## How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
Manual tests:
Build document and check document
Configure `spark.ssl.enabled` only, it throws exception below:
6/08/16 16:04:37 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(mwang); groups with view permissions: Set(); users with modify permissions: Set(mwang); groups with modify permissions: Set()
Exception in thread "main" java.lang.IllegalArgumentException: requirement failed: spark.ssl.protocol is required when enabling SSL connections.
at scala.Predef$.require(Predef.scala:224)
at org.apache.spark.SecurityManager.<init>(SecurityManager.scala:285)
at org.apache.spark.deploy.master.Master$.startRpcEnvAndEndpoint(Master.scala:1026)
at org.apache.spark.deploy.master.Master$.main(Master.scala:1011)
at org.apache.spark.deploy.master.Master.main(Master.scala)
Configure `spark.ssl.protocol` and `spark.ssl.protocol`
It works fine.
Author: wm624@hotmail.com <wm624@hotmail.com>
Closes #14674 from wangmiao1981/ssl.
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/configuration.md | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 96e8c6d08a..4bda464b98 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -1472,6 +1472,9 @@ Apart from these, the following properties are also available, and may be useful <td> <p>Whether to enable SSL connections on all supported protocols.</p> + <p>When <code>spark.ssl.enabled</code> is configured, <code>spark.ssl.protocol</code> + is required.</p> + <p>All the SSL settings like <code>spark.ssl.xxx</code> where <code>xxx</code> is a particular configuration property, denote the global configuration for all the supported protocols. In order to override the global configuration for the particular protocol, |