diff options
| author | Marcelo Vanzin <vanzin@cloudera.com> | 2015-03-04 12:58:39 -0800 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2015-03-04 12:58:47 -0800 |
| commit | 3fc74f45a9ec9544c04c71ce1412f6bc2eb6e75b (patch) | |
| tree | 77c4193f686d050bfc179bfa0972b37f7679b654 /LICENSE | |
| parent | bfa4e3194f14d941cd8fa61a845d892a5c5027c6 (diff) | |
| download | spark-3fc74f45a9ec9544c04c71ce1412f6bc2eb6e75b.tar.gz spark-3fc74f45a9ec9544c04c71ce1412f6bc2eb6e75b.tar.bz2 spark-3fc74f45a9ec9544c04c71ce1412f6bc2eb6e75b.zip | |
[SPARK-6144] [core] Fix addFile when source files are on "hdfs:"
The code failed in two modes: it complained when it tried to re-create a directory that already existed, and it was placing some files in the wrong parent directory. The patch fixes both issues.
Author: Marcelo Vanzin <vanzin@cloudera.com>
Author: trystanleftwich <trystan@atscale.com>
Closes #4894 from vanzin/SPARK-6144 and squashes the following commits:
100b3a1 [Marcelo Vanzin] Style fix.
58266aa [Marcelo Vanzin] Fix fetchHcfs file for directories.
91733b7 [trystanleftwich] [SPARK-6144]When in cluster mode using ADD JAR with a hdfs:// sourced jar will fail
(cherry picked from commit 3a35a0dfe940843c3f3a5f51acfe24def488faa9)
Signed-off-by: Andrew Or <andrew@databricks.com>
Diffstat (limited to 'LICENSE')
0 files changed, 0 insertions, 0 deletions