diff options
author | Doug Balog <doug.balog@target.com> | 2015-04-13 09:49:58 -0500 |
---|---|---|
committer | Thomas Graves <tgraves@apache.org> | 2015-04-13 09:49:58 -0500 |
commit | 77620be76e82b6cdaae406cd752d3272656f5fe0 (patch) | |
tree | c157aa8a6c1eb394fbec3f63d99550426411882f /mllib/src | |
parent | b29663eeea440b1d1a288d41b5ddf67e77c5bd54 (diff) | |
download | spark-77620be76e82b6cdaae406cd752d3272656f5fe0.tar.gz spark-77620be76e82b6cdaae406cd752d3272656f5fe0.tar.bz2 spark-77620be76e82b6cdaae406cd752d3272656f5fe0.zip |
[SPARK-6207] [YARN] [SQL] Adds delegation tokens for metastore to conf.
Adds hive2-metastore delegation token to conf when running in secure mode.
Without this change, running on YARN in cluster mode fails with a
GSS exception.
This is a rough patch that adds a dependency to spark/yarn on hive-exec.
I'm looking for suggestions on how to make this patch better.
This contribution is my original work and that I licenses the work to the
Apache Spark project under the project's open source licenses.
Author: Doug Balog <doug.balogtarget.com>
Author: Doug Balog <doug.balog@target.com>
Closes #5031 from dougb/SPARK-6207 and squashes the following commits:
3e9ac16 [Doug Balog] [SPARK-6207] Fixes minor code spacing issues.
e260765 [Doug Balog] [SPARK-6207] Second pass at adding Hive delegation token to conf. - Use reflection instead of adding dependency on hive. - Tested on Hive 0.13 and Hadoop 2.4.1
1ab1729 [Doug Balog] Merge branch 'master' of git://github.com/apache/spark into SPARK-6207
bf356d2 [Doug Balog] [SPARK-6207] [YARN] [SQL] Adds delegation tokens for metastore to conf. Adds hive2-metastore delagations token to conf when running in securemode. Without this change, runing on YARN in cluster mode fails with a GSS exception.
Diffstat (limited to 'mllib/src')
0 files changed, 0 insertions, 0 deletions