diff options
| author | Thomas Graves <tgraves@apache.org> | 2015-02-02 22:45:55 -0800 |
|---|---|---|
| committer | Josh Rosen <joshrosen@databricks.com> | 2015-02-02 22:45:55 -0800 |
| commit | c31c36c4a76bd3449696383321332ec95bff7fed (patch) | |
| tree | 46b1d56b1c17073ae817a0a6ffa2fc155613edcc /examples | |
| parent | eb0da6c4bd55aaab972c53eb934e68257b8994e5 (diff) | |
| download | spark-c31c36c4a76bd3449696383321332ec95bff7fed.tar.gz spark-c31c36c4a76bd3449696383321332ec95bff7fed.tar.bz2 spark-c31c36c4a76bd3449696383321332ec95bff7fed.zip | |
[SPARK-3778] newAPIHadoopRDD doesn't properly pass credentials for secure hdfs
.this was https://github.com/apache/spark/pull/2676
https://issues.apache.org/jira/browse/SPARK-3778
This affects if someone is trying to access secure hdfs something like:
val lines = {
val hconf = new Configuration()
hconf.set("mapred.input.dir", "mydir")
hconf.set("textinputformat.record.delimiter","\003432\n")
sc.newAPIHadoopRDD(hconf, classOf[TextInputFormat], classOf[LongWritable], classOf[Text])
}
Author: Thomas Graves <tgraves@apache.org>
Closes #4292 from tgravescs/SPARK-3788 and squashes the following commits:
cf3b453 [Thomas Graves] newAPIHadoopRDD doesn't properly pass credentials for secure hdfs on yarn
Diffstat (limited to 'examples')
0 files changed, 0 insertions, 0 deletions