diff options
| author | Thomas Graves <tgraves@apache.org> | 2014-01-08 08:49:20 -0600 |
|---|---|---|
| committer | Thomas Graves <tgraves@apache.org> | 2014-01-08 08:49:20 -0600 |
| commit | 6eef78d769379b98a1fa6d4f2fa606216e5063a6 (patch) | |
| tree | 47ca5ed7b3a4a5f1732a0647d564ec5218107fa2 /docs/running-on-yarn.md | |
| parent | bb6a39a6872fb8e7118c5a402b7b9d67459e9a64 (diff) | |
| parent | 67af8031368c4a3558aeb46c290b7b7a09516539 (diff) | |
| download | spark-6eef78d769379b98a1fa6d4f2fa606216e5063a6.tar.gz spark-6eef78d769379b98a1fa6d4f2fa606216e5063a6.tar.bz2 spark-6eef78d769379b98a1fa6d4f2fa606216e5063a6.zip | |
Merge pull request #345 from colorant/yarn
support distributing extra files to worker for yarn client mode
So that user doesn't need to package all dependency into one assemble jar as spark app jar
Diffstat (limited to 'docs/running-on-yarn.md')
| -rw-r--r-- | docs/running-on-yarn.md | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 717071d72c..b206270107 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -114,6 +114,8 @@ For example: SPARK_YARN_APP_JAR=examples/target/scala-{{site.SCALA_VERSION}}/spark-examples-assembly-{{site.SPARK_VERSION}}.jar \ MASTER=yarn-client ./bin/spark-shell +You can also send extra files to yarn cluster for worker to use by exporting SPARK_YARN_DIST_FILES=file1,file2... etc. + # Building Spark for Hadoop/YARN 2.2.x See [Building Spark with Maven](building-with-maven.html) for instructions on how to build Spark using the Maven process. |