diff options
| -rw-r--r-- | docs/configuration.md | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 4bb5371cc2..1f9fa70566 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -399,6 +399,14 @@ Apart from these, the following properties are also available, and may be useful </td> </tr> <tr> + <td>spark.shuffle.file.buffer.kb</td> + <td>100</td> + <td> + Size of the in-memory buffer for each shuffle file output stream, in kilobytes. These buffers + reduce the number of disk seeks and system calls made in creating intermediate shuffle files. + </td> +</tr> +<tr> <td>spark.shuffle.spill</td> <td>true</td> <td> |