diff options
| author | Marcelo Vanzin <vanzin@cloudera.com> | 2015-02-26 17:35:03 +0000 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-02-26 17:35:03 +0000 |
| commit | df3d559b32f1ceb8ca3491e2a1169c56a6faab58 (patch) | |
| tree | e24a03547edfe1c1bf188b9fa00c0a4f9ad2d724 /sql/core | |
| parent | 192e42a2933eb283e12bfdfb46e2ef895228af4a (diff) | |
| download | spark-df3d559b32f1ceb8ca3491e2a1169c56a6faab58.tar.gz spark-df3d559b32f1ceb8ca3491e2a1169c56a6faab58.tar.bz2 spark-df3d559b32f1ceb8ca3491e2a1169c56a6faab58.zip | |
[SPARK-5801] [core] Avoid creating nested directories.
Cache the value of the local root dirs to use for storing local data,
so that the same directories are reused.
Also, to avoid an extra level of nesting, use a different env variable
to propagate the local dirs from the Worker to the executors. And make
the executor directory use a different name.
Author: Marcelo Vanzin <vanzin@cloudera.com>
Closes #4747 from vanzin/SPARK-5801 and squashes the following commits:
e0114e1 [Marcelo Vanzin] Update unit test.
18ee0a7 [Marcelo Vanzin] [SPARK-5801] [core] Avoid creating nested directories.
Diffstat (limited to 'sql/core')
0 files changed, 0 insertions, 0 deletions