diff options
author | Thomas Graves <tgraves@apache.org> | 2014-08-05 12:48:26 -0500 |
---|---|---|
committer | Thomas Graves <tgraves@apache.org> | 2014-08-05 12:48:51 -0500 |
commit | 6c0c65fc85677ab2cae819a546ea50ed660994c3 (patch) | |
tree | 362d4c5a4e410aaa227611b8e5d3f76c742ad6b5 /docs/configuration.md | |
parent | b92a450583989470ff53b62c124d908ad661e29a (diff) | |
download | spark-6c0c65fc85677ab2cae819a546ea50ed660994c3.tar.gz spark-6c0c65fc85677ab2cae819a546ea50ed660994c3.tar.bz2 spark-6c0c65fc85677ab2cae819a546ea50ed660994c3.zip |
SPARK-1528 - spark on yarn, add support for accessing remote HDFS
Add a config (spark.yarn.access.namenodes) to allow applications running on yarn to access other secure HDFS cluster. User just specifies the namenodes of the other clusters and we get Tokens for those and ship them with the spark application.
Author: Thomas Graves <tgraves@apache.org>
Closes #1159 from tgravescs/spark-1528 and squashes the following commits:
ddbcd16 [Thomas Graves] review comments
0ac8501 [Thomas Graves] SPARK-1528 - add support for accessing remote HDFS
(cherry picked from commit 2c0f705e26ca3dfc43a1e9a0722c0e57f67c970a)
Signed-off-by: Thomas Graves <tgraves@apache.org>
Diffstat (limited to 'docs/configuration.md')
0 files changed, 0 insertions, 0 deletions