diff options
| author | Michael Gummelt <mgummelt@mesosphere.io> | 2016-07-08 20:20:26 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-07-08 20:20:26 -0700 |
| commit | b1db26acc51003e68e4e8d7d324cf74e3aa03cfd (patch) | |
| tree | e03b2e11b19823f9921499a6cf67dfbe264e05bc /docs | |
| parent | d8b06f18dc3e35938d15099beac98221d6f528b5 (diff) | |
| download | spark-b1db26acc51003e68e4e8d7d324cf74e3aa03cfd.tar.gz spark-b1db26acc51003e68e4e8d7d324cf74e3aa03cfd.tar.bz2 spark-b1db26acc51003e68e4e8d7d324cf74e3aa03cfd.zip | |
[SPARK-11857][MESOS] Deprecate fine grained
## What changes were proposed in this pull request?
Documentation changes to indicate that fine-grained mode is now deprecated. No code changes were made, and all fine-grained mode instructions were left in place. We can remove all of that once the deprecation cycle completes (Does Spark have a standard deprecation cycle? One major version?)
Blocked on https://github.com/apache/spark/pull/14059
## How was this patch tested?
Viewed in Github
Author: Michael Gummelt <mgummelt@mesosphere.io>
Closes #14078 from mgummelt/deprecate-fine-grained.
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/running-on-mesos.md | 9 |
1 files changed, 7 insertions, 2 deletions
diff --git a/docs/running-on-mesos.md b/docs/running-on-mesos.md index 8ab5f30220..5219e99fee 100644 --- a/docs/running-on-mesos.md +++ b/docs/running-on-mesos.md @@ -181,7 +181,7 @@ Note that jars or python files that are passed to spark-submit should be URIs re # Mesos Run Modes Spark can run over Mesos in two modes: "coarse-grained" (default) and -"fine-grained". +"fine-grained" (deprecated). ## Coarse-Grained @@ -213,7 +213,12 @@ the application. To configure your job to dynamically adjust to its resource requirements, look into [Dynamic Allocation](#dynamic-resource-allocation-with-mesos). -## Fine-Grained +## Fine-Grained (deprecated) + +**NOTE:** Fine-grained mode is deprecated as of Spark 2.0.0. Consider + using [Dynamic Allocation](#dynamic-resource-allocation-with-mesos) + for some of the benefits. For a full explanation see + [SPARK-11857](https://issues.apache.org/jira/browse/SPARK-11857) In "fine-grained" mode, each Spark task inside the Spark executor runs as a separate Mesos task. This allows multiple instances of Spark (and |