diff options
| author | Yinan Li <liyinan926@gmail.com> | 2014-01-17 17:27:25 -0800 |
|---|---|---|
| committer | Yinan Li <liyinan926@gmail.com> | 2014-01-18 15:26:59 -0800 |
| commit | fd833e7ab1bf006c5ae1dff4767b02729e1bbfa7 (patch) | |
| tree | cd67e9926fc20a5402d0e4b1da33ef2873188d75 /docs/configuration.md | |
| parent | aa981e4e97a11dbd5a4d012bfbdb395982968372 (diff) | |
| download | spark-fd833e7ab1bf006c5ae1dff4767b02729e1bbfa7.tar.gz spark-fd833e7ab1bf006c5ae1dff4767b02729e1bbfa7.tar.bz2 spark-fd833e7ab1bf006c5ae1dff4767b02729e1bbfa7.zip | |
Allow files added through SparkContext.addFile() to be overwritten
This is useful for the cases when a file needs to be refreshed and downloaded
by the executors periodically.
Signed-off-by: Yinan Li <liyinan926@gmail.com>
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index da70cabba2..3b565e4347 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -431,6 +431,7 @@ Apart from these, the following properties are also available, and may be useful </td> </tr> <tr> +<<<<<<< HEAD <td>spark.logConf</td> <td>false</td> <td> @@ -459,6 +460,13 @@ Apart from these, the following properties are also available, and may be useful the whole cluster by default. <br/> <b>Note:</b> this setting needs to be configured in the standalone cluster master, not in individual applications; you can set it through <code>SPARK_JAVA_OPTS</code> in <code>spark-env.sh</code>. +</td> +</tr> +<tr> + <td>spark.files.overwrite</td> + <td>false</td> + <td> + Whether to overwrite files added through SparkContext.addFile() when the target file exists and its contents do not match those of the source. </td> </tr> </table> |