diff options
| author | 许鹏 <peng.xu@fraudmetrix.cn> | 2015-02-26 23:05:56 -0800 |
|---|---|---|
| committer | Andrew Or <andrew@databricks.com> | 2015-02-26 23:06:34 -0800 |
| commit | 0375a413b8a009f5820897691570a1273ee25b97 (patch) | |
| tree | 8210e9809faf3911167c8a8b98a8c13a6b722ebd | |
| parent | 7c99a014fb1e370e038e0f537c2301ca8138e620 (diff) | |
| download | spark-0375a413b8a009f5820897691570a1273ee25b97.tar.gz spark-0375a413b8a009f5820897691570a1273ee25b97.tar.bz2 spark-0375a413b8a009f5820897691570a1273ee25b97.zip | |
fix spark-6033, clarify the spark.worker.cleanup behavior in standalone mode
jira case spark-6033 https://issues.apache.org/jira/browse/SPARK-6033
In standalone deploy mode, the cleanup will only remove the stopped application's directories.
The original description about the cleanup behavior is incorrect.
Author: 许鹏 <peng.xu@fraudmetrix.cn>
Closes #4803 from hseagle/spark-6033 and squashes the following commits:
927a6a0 [许鹏] fix the incorrect description about the spark.worker.cleanup in standalone mode
| -rw-r--r-- | docs/spark-standalone.md | 3 |
1 files changed, 1 insertions, 2 deletions
diff --git a/docs/spark-standalone.md b/docs/spark-standalone.md index 5c6084fb46..74d8653a8b 100644 --- a/docs/spark-standalone.md +++ b/docs/spark-standalone.md @@ -222,8 +222,7 @@ SPARK_WORKER_OPTS supports the following system properties: <td>false</td> <td> Enable periodic cleanup of worker / application directories. Note that this only affects standalone - mode, as YARN works differently. Applications directories are cleaned up regardless of whether - the application is still running. + mode, as YARN works differently. Only the directories of stopped applications are cleaned up. </td> </tr> <tr> |