diff options
| author | WangTaoTheTonic <barneystinson@aliyun.com> | 2014-10-16 19:12:39 -0700 |
|---|---|---|
| committer | Andrew Or <andrewor14@gmail.com> | 2014-10-16 19:13:06 -0700 |
| commit | 2c41170834c40a511cdcbe5525180bba68922682 (patch) | |
| tree | 39248e97463d4c8f9656fd93d181bc204baa3f85 | |
| parent | 61e590354c08e0ee6215ead26e6dcda0e9ad501b (diff) | |
| download | spark-2c41170834c40a511cdcbe5525180bba68922682.tar.gz spark-2c41170834c40a511cdcbe5525180bba68922682.tar.bz2 spark-2c41170834c40a511cdcbe5525180bba68922682.zip | |
[SPARK-3890][Docs]remove redundant spark.executor.memory in doc
Introduced in https://github.com/pwendell/spark/commit/f7e79bc42c1635686c3af01eef147dae92de2529, I'm not sure why we need two spark.executor.memory here.
Author: WangTaoTheTonic <barneystinson@aliyun.com>
Author: WangTao <barneystinson@aliyun.com>
Closes #2745 from WangTaoTheTonic/redundantconfig and squashes the following commits:
e7564dc [WangTao] too long line
fdbdb1f [WangTaoTheTonic] trivial workaround
d06b6e5 [WangTaoTheTonic] remove redundant spark.executor.memory in doc
(cherry picked from commit e7f4ea8a52f0d3d56684b4f9caadce978eac4816)
Signed-off-by: Andrew Or <andrewor14@gmail.com>
| -rw-r--r-- | docs/configuration.md | 16 |
1 files changed, 4 insertions, 12 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 3b5751a982..a91967aeac 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -154,14 +154,6 @@ Apart from these, the following properties are also available, and may be useful <table class="table"> <tr><th>Property Name</th><th>Default</th><th>Meaning</th></tr> <tr> - <td><code>spark.executor.memory</code></td> - <td>512m</td> - <td> - Amount of memory to use per executor process, in the same format as JVM memory strings - (e.g. <code>512m</code>, <code>2g</code>). - </td> -</tr> -<tr> <td><code>spark.executor.extraJavaOptions</code></td> <td>(none)</td> <td> @@ -329,7 +321,7 @@ Apart from these, the following properties are also available, and may be useful <td><code>spark.ui.port</code></td> <td>4040</td> <td> - Port for your application's dashboard, which shows memory and workload data + Port for your application's dashboard, which shows memory and workload data. </td> </tr> <tr> @@ -843,8 +835,8 @@ Apart from these, the following properties are also available, and may be useful <td><code>spark.scheduler.revive.interval</code></td> <td>1000</td> <td> - The interval length for the scheduler to revive the worker resource offers to run tasks. - (in milliseconds) + The interval length for the scheduler to revive the worker resource offers to run tasks + (in milliseconds). </td> </tr> </tr> @@ -856,7 +848,7 @@ Apart from these, the following properties are also available, and may be useful to wait for before scheduling begins. Specified as a double between 0 and 1. Regardless of whether the minimum ratio of resources has been reached, the maximum amount of time it will wait before scheduling begins is controlled by config - <code>spark.scheduler.maxRegisteredResourcesWaitingTime</code> + <code>spark.scheduler.maxRegisteredResourcesWaitingTime</code>. </td> </tr> <tr> |