diff options
| author | Reynold Xin <rxin@apache.org> | 2014-01-30 09:33:18 -0800 |
|---|---|---|
| committer | Reynold Xin <rxin@apache.org> | 2014-01-30 09:33:18 -0800 |
| commit | ac712e48af3068672e629cec7766caae3cd77c37 (patch) | |
| tree | a21a97a1ed0e6148b6168f4fe1be5339026786f2 /docs | |
| parent | 0ff38c22205f14770ecca1e66378e7c207ca2d1d (diff) | |
| download | spark-ac712e48af3068672e629cec7766caae3cd77c37.tar.gz spark-ac712e48af3068672e629cec7766caae3cd77c37.tar.bz2 spark-ac712e48af3068672e629cec7766caae3cd77c37.zip | |
Merge pull request #524 from rxin/doc
Added spark.shuffle.file.buffer.kb to configuration doc.
Author: Reynold Xin <rxin@apache.org>
== Merge branch commits ==
commit 0eea1d761ff772ff89be234e1e28035d54e5a7de
Author: Reynold Xin <rxin@apache.org>
Date: Wed Jan 29 14:40:48 2014 -0800
Added spark.shuffle.file.buffer.kb to configuration doc.
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/configuration.md | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 4bb5371cc2..1f9fa70566 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -399,6 +399,14 @@ Apart from these, the following properties are also available, and may be useful </td> </tr> <tr> + <td>spark.shuffle.file.buffer.kb</td> + <td>100</td> + <td> + Size of the in-memory buffer for each shuffle file output stream, in kilobytes. These buffers + reduce the number of disk seeks and system calls made in creating intermediate shuffle files. + </td> +</tr> +<tr> <td>spark.shuffle.spill</td> <td>true</td> <td> |