diff options
| author | Sandy Ryza <sandy@cloudera.com> | 2014-12-08 16:28:36 -0800 |
|---|---|---|
| committer | Josh Rosen <joshrosen@databricks.com> | 2014-12-08 16:28:57 -0800 |
| commit | f4160324c55b4d168421af5473ce306bc03a77bb (patch) | |
| tree | a7941e997fe4e737465074647032c7a96111ee4a /docs | |
| parent | 9ed5641a5a4425278283896928efa4e382fb74d8 (diff) | |
| download | spark-f4160324c55b4d168421af5473ce306bc03a77bb.tar.gz spark-f4160324c55b4d168421af5473ce306bc03a77bb.tar.bz2 spark-f4160324c55b4d168421af5473ce306bc03a77bb.zip | |
SPARK-4770. [DOC] [YARN] spark.scheduler.minRegisteredResourcesRatio doc...
...umented default is incorrect for YARN
Author: Sandy Ryza <sandy@cloudera.com>
Closes #3624 from sryza/sandy-spark-4770 and squashes the following commits:
bd81a3a [Sandy Ryza] SPARK-4770. [DOC] [YARN] spark.scheduler.minRegisteredResourcesRatio documented default is incorrect for YARN
(cherry picked from commit cda94d15ea2a70ed3f0651ba2766b1e2f80308c1)
Signed-off-by: Josh Rosen <joshrosen@databricks.com>
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/configuration.md | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index cdd9f1ea1f..55d41c0ea5 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -939,11 +939,11 @@ Apart from these, the following properties are also available, and may be useful </tr> </tr> <td><code>spark.scheduler.minRegisteredResourcesRatio</code></td> - <td>0</td> + <td>0.0 for Mesos and Standalone mode, 0.8 for YARN</td> <td> The minimum ratio of registered resources (registered resources / total expected resources) (resources are executors in yarn mode, CPU cores in standalone mode) - to wait for before scheduling begins. Specified as a double between 0 and 1. + to wait for before scheduling begins. Specified as a double between 0.0 and 1.0. Regardless of whether the minimum ratio of resources has been reached, the maximum amount of time it will wait before scheduling begins is controlled by config <code>spark.scheduler.maxRegisteredResourcesWaitingTime</code>. |