diff options
author | Tsuyoshi Ozawa <ozawa.tsuyoshi@lab.ntt.co.jp> | 2014-12-22 11:28:05 -0800 |
---|---|---|
committer | Andrew Or <andrew@databricks.com> | 2014-12-22 11:28:15 -0800 |
commit | 31d42c4d8ceef461db43cdb709a365f65598aa3c (patch) | |
tree | 5a5674f38382e4a4984b5641cfc1865c1a943b47 /docs/job-scheduling.md | |
parent | b896963728154ec51689fd3e975fc5033eb24d8c (diff) | |
download | spark-31d42c4d8ceef461db43cdb709a365f65598aa3c.tar.gz spark-31d42c4d8ceef461db43cdb709a365f65598aa3c.tar.bz2 spark-31d42c4d8ceef461db43cdb709a365f65598aa3c.zip |
[SPARK-4915][YARN] Fix classname to be specified for external shuffle service.
Author: Tsuyoshi Ozawa <ozawa.tsuyoshi@lab.ntt.co.jp>
Closes #3757 from oza/SPARK-4915 and squashes the following commits:
3b0d6d6 [Tsuyoshi Ozawa] Fix classname to be specified for external shuffle service.
(cherry picked from commit 96606f69b7cd88edea5d4b6427f598a91ccb4c33)
Signed-off-by: Andrew Or <andrew@databricks.com>
Diffstat (limited to 'docs/job-scheduling.md')
-rw-r--r-- | docs/job-scheduling.md | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/docs/job-scheduling.md b/docs/job-scheduling.md index dfbb871f01..a5425eb355 100644 --- a/docs/job-scheduling.md +++ b/docs/job-scheduling.md @@ -98,7 +98,7 @@ pre-packaged distribution. 2. Add this jar to the classpath of all `NodeManager`s in your cluster. 3. In the `yarn-site.xml` on each node, add `spark_shuffle` to `yarn.nodemanager.aux-services`, then set `yarn.nodemanager.aux-services.spark_shuffle.class` to -`org.apache.spark.yarn.network.YarnShuffleService`. Additionally, set all relevant +`org.apache.spark.network.yarn.YarnShuffleService`. Additionally, set all relevant `spark.shuffle.service.*` [configurations](configuration.html). 4. Restart all `NodeManager`s in your cluster. |