diff options
| author | Steve Loughran <stevel@hortonworks.com> | 2016-05-26 13:55:22 -0500 |
|---|---|---|
| committer | Tom Graves <tgraves@yahoo-inc.com> | 2016-05-26 13:55:22 -0500 |
| commit | 01b350a4f7c17d6516b27b6cd27ba8390834d40c (patch) | |
| tree | 166d6b9a2c7bfb8cc7dbf180c29393287cf7371a /yarn | |
| parent | c76457c8e422ce6fbf72a8fe5db94565783b12d0 (diff) | |
| download | spark-01b350a4f7c17d6516b27b6cd27ba8390834d40c.tar.gz spark-01b350a4f7c17d6516b27b6cd27ba8390834d40c.tar.bz2 spark-01b350a4f7c17d6516b27b6cd27ba8390834d40c.zip | |
[SPARK-13148][YARN] document zero-keytab Oozie application launch; add diagnostics
This patch provides detail on what to do for keytabless Oozie launches of spark apps, and adds some debug-level diagnostics of what credentials have been submitted
Author: Steve Loughran <stevel@hortonworks.com>
Author: Steve Loughran <stevel@apache.org>
Closes #11033 from steveloughran/stevel/feature/SPARK-13148-oozie.
Diffstat (limited to 'yarn')
| -rw-r--r-- | yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala b/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala index a12391d081..598eb17d5d 100644 --- a/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala +++ b/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala @@ -375,6 +375,9 @@ private[spark] class Client( val distributedNames = new HashSet[String] YarnSparkHadoopUtil.get.obtainTokenForHiveMetastore(sparkConf, hadoopConf, credentials) YarnSparkHadoopUtil.get.obtainTokenForHBase(sparkConf, hadoopConf, credentials) + if (credentials != null) { + logDebug(YarnSparkHadoopUtil.get.dumpTokens(credentials).mkString("\n")) + } val replication = sparkConf.get(STAGING_FILE_REPLICATION).map(_.toShort) .getOrElse(fs.getDefaultReplication(destDir)) |