diff options
| author | lewuathe <lewuathe@me.com> | 2015-01-11 13:50:42 -0800 |
|---|---|---|
| committer | Aaron Davidson <aaron@databricks.com> | 2015-01-11 13:50:42 -0800 |
| commit | 1656aae2b4e8b026f8cfe782519f72d32ed2b291 (patch) | |
| tree | 1b3e35b9bbcd34015499b1ff7bc28702cdf20524 /docs/configuration.md | |
| parent | 33132609096d7fa45001c6a67724ec60bcaefaa9 (diff) | |
| download | spark-1656aae2b4e8b026f8cfe782519f72d32ed2b291.tar.gz spark-1656aae2b4e8b026f8cfe782519f72d32ed2b291.tar.bz2 spark-1656aae2b4e8b026f8cfe782519f72d32ed2b291.zip | |
[SPARK-5073] spark.storage.memoryMapThreshold have two default value
Because major OS page sizes is about 4KB, the default value of spark.storage.memoryMapThreshold is integrated to 2 * 4096
Author: lewuathe <lewuathe@me.com>
Closes #3900 from Lewuathe/integrate-memoryMapThreshold and squashes the following commits:
e417acd [lewuathe] [SPARK-5073] Update docs/configuration
834aba4 [lewuathe] [SPARK-5073] Fix style
adcea33 [lewuathe] [SPARK-5073] Integrate memory map threshold to 2MB
fcce2e5 [lewuathe] [SPARK-5073] spark.storage.memoryMapThreshold have two default value
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 2add48569b..f292bfbb7d 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -678,7 +678,7 @@ Apart from these, the following properties are also available, and may be useful </tr> <tr> <td><code>spark.storage.memoryMapThreshold</code></td> - <td>8192</td> + <td>2097152</td> <td> Size of a block, in bytes, above which Spark memory maps when reading a block from disk. This prevents Spark from memory mapping very small blocks. In general, memory |