diff options
| author | Kent Yao <yaooqinn@hotmail.com> | 2017-02-21 09:57:40 -0800 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2017-02-21 09:57:40 -0800 |
| commit | 7363dde6348fd70d67a13bb4644baca7c77ac241 (patch) | |
| tree | e31e5b2bdb9f6ceb185ddde86aba768cf0b0bde8 | |
| parent | 280afe0ef384433eae2076cda569c5f1b3e49d42 (diff) | |
| download | spark-7363dde6348fd70d67a13bb4644baca7c77ac241.tar.gz spark-7363dde6348fd70d67a13bb4644baca7c77ac241.tar.bz2 spark-7363dde6348fd70d67a13bb4644baca7c77ac241.zip | |
[SPARK-19626][YARN] Using the correct config to set credentials update time
## What changes were proposed in this pull request?
In https://github.com/apache/spark/pull/14065, we introduced a configurable credential manager for Spark running on YARN. Also two configs `spark.yarn.credentials.renewalTime` and `spark.yarn.credentials.updateTime` were added, one is for the credential renewer and the other updater. But now we just query `spark.yarn.credentials.renewalTime` by mistake during CREDENTIALS UPDATING, where should be actually `spark.yarn.credentials.updateTime` .
This PR fixes this mistake.
## How was this patch tested?
existing test
cc jerryshao vanzin
Author: Kent Yao <yaooqinn@hotmail.com>
Closes #16955 from yaooqinn/cred_update.
| -rw-r--r-- | resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala b/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala index 5df4fbd9c1..2fdb70a73c 100644 --- a/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala +++ b/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala @@ -55,7 +55,7 @@ private[spark] class CredentialUpdater( /** Start the credential updater task */ def start(): Unit = { - val startTime = sparkConf.get(CREDENTIALS_RENEWAL_TIME) + val startTime = sparkConf.get(CREDENTIALS_UPDATE_TIME) val remainingTime = startTime - System.currentTimeMillis() if (remainingTime <= 0) { credentialUpdater.schedule(credentialUpdaterRunnable, 1, TimeUnit.MINUTES) |