diff options
| author | tgravescs <tgraves_cs@yahoo.com> | 2013-11-04 09:40:40 -0600 |
|---|---|---|
| committer | tgravescs <tgraves_cs@yahoo.com> | 2013-11-04 16:16:28 -0600 |
| commit | a35472e1dd2ea1b5a0b1fb6b382f5a98f5aeba5a (patch) | |
| tree | 9af869314d823270e47861208d2388a6e4c5c798 /docs | |
| parent | b5dc3393a586099229fcd293d96f909e596a11e6 (diff) | |
| download | spark-a35472e1dd2ea1b5a0b1fb6b382f5a98f5aeba5a.tar.gz spark-a35472e1dd2ea1b5a0b1fb6b382f5a98f5aeba5a.tar.bz2 spark-a35472e1dd2ea1b5a0b1fb6b382f5a98f5aeba5a.zip | |
Allow spark on yarn to be run from HDFS. Allows the spark.jar, app.jar, and log4j.properties to be put into hdfs.
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/running-on-yarn.md | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 2898af0bed..6fd1d0d150 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -21,6 +21,7 @@ The assembled JAR will be something like this: # Preparations - Building a YARN-enabled assembly (see above). +- The assembled jar can be installed into HDFS or used locally. - Your application code must be packaged into a separate JAR file. If you want to test out the YARN deployment mode, you can use the current Spark examples. A `spark-examples_{{site.SCALA_VERSION}}-{{site.SPARK_VERSION}}` file can be generated by running `sbt/sbt assembly`. NOTE: since the documentation you're reading is for Spark version {{site.SPARK_VERSION}}, we are assuming here that you have downloaded Spark {{site.SPARK_VERSION}} or checked it out of source control. If you are using a different version of Spark, the version numbers in the jar generated by the sbt package command will obviously be different. |