diff options
| author | Jeff Zhang <zjffdu@apache.org> | 2016-01-08 11:38:46 -0800 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2016-01-08 11:38:46 -0800 |
| commit | 00d9261724feb48d358679efbae6889833e893e0 (patch) | |
| tree | d8f7f02313bc46bf025f9df2e2ce1897051df4ba /docs/job-scheduling.md | |
| parent | ea104b8f1ce8aa109d1b16b696a61a47df6283b2 (diff) | |
| download | spark-00d9261724feb48d358679efbae6889833e893e0.tar.gz spark-00d9261724feb48d358679efbae6889833e893e0.tar.bz2 spark-00d9261724feb48d358679efbae6889833e893e0.zip | |
[DOCUMENTATION] doc fix of job scheduling
spark.shuffle.service.enabled is spark application related configuration, it is not necessary to set it in yarn-site.xml
Author: Jeff Zhang <zjffdu@apache.org>
Closes #10657 from zjffdu/doc-fix.
Diffstat (limited to 'docs/job-scheduling.md')
| -rw-r--r-- | docs/job-scheduling.md | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/docs/job-scheduling.md b/docs/job-scheduling.md index 36327c6efe..6c587b3f0d 100644 --- a/docs/job-scheduling.md +++ b/docs/job-scheduling.md @@ -91,7 +91,7 @@ pre-packaged distribution. 2. Add this jar to the classpath of all `NodeManager`s in your cluster. 3. In the `yarn-site.xml` on each node, add `spark_shuffle` to `yarn.nodemanager.aux-services`, then set `yarn.nodemanager.aux-services.spark_shuffle.class` to -`org.apache.spark.network.yarn.YarnShuffleService` and `spark.shuffle.service.enabled` to true. +`org.apache.spark.network.yarn.YarnShuffleService`. 4. Restart all `NodeManager`s in your cluster. All other relevant configurations are optional and under the `spark.dynamicAllocation.*` and |