diff options
| author | Tom Graves <tgraves@yahoo-inc.com> | 2016-01-15 13:11:27 +0000 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2016-01-15 13:11:27 +0000 |
| commit | 96fb894d4b33e293625fa92bbeccbbf5e688015e (patch) | |
| tree | 66fa4209ed67a4123f1559ba624ff3e660e61b24 /docs/running-on-yarn.md | |
| parent | d0a5c32bd05841f411a342a80c5da9f73f30d69a (diff) | |
| download | spark-96fb894d4b33e293625fa92bbeccbbf5e688015e.tar.gz spark-96fb894d4b33e293625fa92bbeccbbf5e688015e.tar.bz2 spark-96fb894d4b33e293625fa92bbeccbbf5e688015e.zip | |
[SPARK-2930] clarify docs on using webhdfs with spark.yarn.access.nam…
…enodes
Author: Tom Graves <tgraves@yahoo-inc.com>
Closes #10699 from tgravescs/SPARK-2930.
Diffstat (limited to 'docs/running-on-yarn.md')
| -rw-r--r-- | docs/running-on-yarn.md | 8 |
1 files changed, 4 insertions, 4 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 06413f83c3..a148c867eb 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -260,10 +260,10 @@ If you need a reference to the proper location to put log files in the YARN so t <td>(none)</td> <td> A comma-separated list of secure HDFS namenodes your Spark application is going to access. For - example, <code>spark.yarn.access.namenodes=hdfs://nn1.com:8032,hdfs://nn2.com:8032</code>. - The Spark application must have access to the namenodes listed and Kerberos must - be properly configured to be able to access them (either in the same realm or in - a trusted realm). Spark acquires security tokens for each of the namenodes so that + example, <code>spark.yarn.access.namenodes=hdfs://nn1.com:8032,hdfs://nn2.com:8032, + webhdfs://nn3.com:50070</code>. The Spark application must have access to the namenodes listed + and Kerberos must be properly configured to be able to access them (either in the same realm + or in a trusted realm). Spark acquires security tokens for each of the namenodes so that the Spark application can access those remote HDFS clusters. </td> </tr> |