diff options
| author | Patrick Wendell <pwendell@gmail.com> | 2013-12-04 18:49:32 -0800 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2013-12-04 18:49:32 -0800 |
| commit | 1450b8ef87d65634800941bbaf259d9b4dd6cc3b (patch) | |
| tree | f3bdd45a5e78f95bc66357f91f38792ddf46bc30 /docs/configuration.md | |
| parent | b1c6fa1584099b3a1e0615c100f10ea90b1ad2c9 (diff) | |
| download | spark-1450b8ef87d65634800941bbaf259d9b4dd6cc3b.tar.gz spark-1450b8ef87d65634800941bbaf259d9b4dd6cc3b.tar.bz2 spark-1450b8ef87d65634800941bbaf259d9b4dd6cc3b.zip | |
Small changes from Matei review
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 1a3eef345c..22abe1c5a9 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -331,7 +331,7 @@ Apart from these, the following properties are also available, and may be useful <td>spark.shuffle.consolidateFiles</td> <td>false</td> <td> - If set to "true", consolidates intermediate files created during a shuffle. + If set to "true", consolidates intermediate files created during a shuffle. Creating fewer files can improve filesystem performance if you run shuffles with large numbers of reduce tasks. </td> </tr> <tr> @@ -346,7 +346,7 @@ Apart from these, the following properties are also available, and may be useful <td>spark.speculation.interval</td> <td>100</td> <td> - How often Spark will check for tasks to speculate, in seconds. + How often Spark will check for tasks to speculate, in milliseconds. </td> </tr> <tr> |