diff options
| author | Aaron Davidson <aaron@databricks.com> | 2014-11-06 19:54:32 -0800 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2014-11-06 19:54:32 -0800 |
| commit | 48a19a6dba896f7d0b637f84e114b7efbb814e51 (patch) | |
| tree | 70fb3c87345730f36e3b9c2f0d94c606b6d8279f /examples | |
| parent | f165b2bbf5d4acf34d826fa55b900f5bbc295654 (diff) | |
| download | spark-48a19a6dba896f7d0b637f84e114b7efbb814e51.tar.gz spark-48a19a6dba896f7d0b637f84e114b7efbb814e51.tar.bz2 spark-48a19a6dba896f7d0b637f84e114b7efbb814e51.zip | |
[SPARK-4236] Cleanup removed applications' files in shuffle service
This relies on a hook from whoever is hosting the shuffle service to invoke removeApplication() when the application is completed. Once invoked, we will clean up all the executors' shuffle directories we know about.
Author: Aaron Davidson <aaron@databricks.com>
Closes #3126 from aarondav/cleanup and squashes the following commits:
33a64a9 [Aaron Davidson] Missing brace
e6e428f [Aaron Davidson] Address comments
16a0d27 [Aaron Davidson] Cleanup
e4df3e7 [Aaron Davidson] [SPARK-4236] Cleanup removed applications' files in shuffle service
Diffstat (limited to 'examples')
0 files changed, 0 insertions, 0 deletions