diff options
| author | Mark Grover <mark@apache.org> | 2016-04-14 18:51:43 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2016-04-14 18:51:43 -0700 |
| commit | ff9ae61a3b7bbbfc2aac93a99c05a9e1ea9c08bc (patch) | |
| tree | b2ea17d703d24540a69f40c66f8bfc35c6a2cc37 /docs/building-spark.md | |
| parent | c80586d9e820d19fc328b3e4c6f1c1439f5583a7 (diff) | |
| download | spark-ff9ae61a3b7bbbfc2aac93a99c05a9e1ea9c08bc.tar.gz spark-ff9ae61a3b7bbbfc2aac93a99c05a9e1ea9c08bc.tar.bz2 spark-ff9ae61a3b7bbbfc2aac93a99c05a9e1ea9c08bc.zip | |
[SPARK-14601][DOC] Minor doc/usage changes related to removal of Spark assembly
## What changes were proposed in this pull request?
Removing references to assembly jar in documentation.
Adding an additional (previously undocumented) usage of spark-submit to run examples.
## How was this patch tested?
Ran spark-submit usage to ensure formatting was fine. Ran examples using SparkSubmit.
Author: Mark Grover <mark@apache.org>
Closes #12365 from markgrover/spark-14601.
Diffstat (limited to 'docs/building-spark.md')
| -rw-r--r-- | docs/building-spark.md | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/docs/building-spark.md b/docs/building-spark.md index 40661604af..fec442af95 100644 --- a/docs/building-spark.md +++ b/docs/building-spark.md @@ -192,7 +192,7 @@ If you have JDK 8 installed but it is not the system default, you can set JAVA_H # Packaging without Hadoop Dependencies for YARN -The assembly jar produced by `mvn package` will, by default, include all of Spark's dependencies, including Hadoop and some of its ecosystem projects. On YARN deployments, this causes multiple versions of these to appear on executor classpaths: the version packaged in the Spark assembly and the version on each node, included with `yarn.application.classpath`. The `hadoop-provided` profile builds the assembly without including Hadoop-ecosystem projects, like ZooKeeper and Hadoop itself. +The assembly directory produced by `mvn package` will, by default, include all of Spark's dependencies, including Hadoop and some of its ecosystem projects. On YARN deployments, this causes multiple versions of these to appear on executor classpaths: the version packaged in the Spark assembly and the version on each node, included with `yarn.application.classpath`. The `hadoop-provided` profile builds the assembly without including Hadoop-ecosystem projects, like ZooKeeper and Hadoop itself. # Building with SBT |