diff options
| author | yangping.wu <wyphao.2007@163.com> | 2015-09-17 09:52:40 -0700 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2015-09-17 09:52:40 -0700 |
| commit | c88bb5df94f9696677c3a429472114bc66f32a52 (patch) | |
| tree | dead95cda77424cc4833da80bbb215ddf41b88ab /docs/running-on-yarn.md | |
| parent | 2a508df20d03b3d4a3c05b65fb02d849bc080ef9 (diff) | |
| download | spark-c88bb5df94f9696677c3a429472114bc66f32a52.tar.gz spark-c88bb5df94f9696677c3a429472114bc66f32a52.tar.bz2 spark-c88bb5df94f9696677c3a429472114bc66f32a52.zip | |
[SPARK-10660] Doc describe error in the "Running Spark on YARN" page
In the Configuration section, the **spark.yarn.driver.memoryOverhead** and **spark.yarn.am.memoryOverhead**‘s default value should be "driverMemory * 0.10, with minimum of 384" and "AM memory * 0.10, with minimum of 384" respectively. Because from Spark 1.4.0, the **MEMORY_OVERHEAD_FACTOR** is set to 0.1.0, not 0.07.
Author: yangping.wu <wyphao.2007@163.com>
Closes #8797 from 397090770/SparkOnYarnDocError.
Diffstat (limited to 'docs/running-on-yarn.md')
| -rw-r--r-- | docs/running-on-yarn.md | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index d1244323ed..3a961d245f 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -211,14 +211,14 @@ If you need a reference to the proper location to put log files in the YARN so t </tr> <tr> <td><code>spark.yarn.driver.memoryOverhead</code></td> - <td>driverMemory * 0.07, with minimum of 384 </td> + <td>driverMemory * 0.10, with minimum of 384 </td> <td> The amount of off heap memory (in megabytes) to be allocated per driver in cluster mode. This is memory that accounts for things like VM overheads, interned strings, other native overheads, etc. This tends to grow with the container size (typically 6-10%). </td> </tr> <tr> <td><code>spark.yarn.am.memoryOverhead</code></td> - <td>AM memory * 0.07, with minimum of 384 </td> + <td>AM memory * 0.10, with minimum of 384 </td> <td> Same as <code>spark.yarn.driver.memoryOverhead</code>, but for the Application Master in client mode. </td> |