diff options
| author | Nicholas Chammas <nicholas.chammas@gmail.com> | 2016-12-05 12:57:41 -0800 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2016-12-05 12:57:47 -0800 |
| commit | 5a92dc76ab431d73275a2bdfbc2c0a8ceb0d75d1 (patch) | |
| tree | 832502166651653e859aa4bb387cbb06ff688e7c /docs | |
| parent | 01a7d33d0851d82fd1bb477a58d9925fe8d727d8 (diff) | |
| download | spark-5a92dc76ab431d73275a2bdfbc2c0a8ceb0d75d1.tar.gz spark-5a92dc76ab431d73275a2bdfbc2c0a8ceb0d75d1.tar.bz2 spark-5a92dc76ab431d73275a2bdfbc2c0a8ceb0d75d1.zip | |
[DOCS][MINOR] Update location of Spark YARN shuffle jar
Looking at the distributions provided on spark.apache.org, I see that the Spark YARN shuffle jar is under `yarn/` and not `lib/`.
This change is so minor I'm not sure it needs a JIRA. But let me know if so and I'll create one.
Author: Nicholas Chammas <nicholas.chammas@gmail.com>
Closes #16130 from nchammas/yarn-doc-fix.
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/running-on-yarn.md | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 4d1fafc07b..d4144c86e9 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -518,7 +518,7 @@ instructions: pre-packaged distribution. 1. Locate the `spark-<version>-yarn-shuffle.jar`. This should be under `$SPARK_HOME/common/network-yarn/target/scala-<version>` if you are building Spark yourself, and under -`lib` if you are using a distribution. +`yarn` if you are using a distribution. 1. Add this jar to the classpath of all `NodeManager`s in your cluster. 1. In the `yarn-site.xml` on each node, add `spark_shuffle` to `yarn.nodemanager.aux-services`, then set `yarn.nodemanager.aux-services.spark_shuffle.class` to |