aboutsummaryrefslogtreecommitdiff
path: root/docs/building-spark.md
diff options
context:
space:
mode:
authorDongjoon Hyun <dongjoon@apache.org>2016-03-18 21:32:48 -0700
committerReynold Xin <rxin@databricks.com>2016-03-18 21:32:48 -0700
commitc11ea2e4138acdd8d4ed487049ded35346bca528 (patch)
tree85f112e9d24eea294fb93fa82383b15b9eabfa77 /docs/building-spark.md
parentf43a26ef9260396761e28aafd5c7b9600c2b04d9 (diff)
downloadspark-c11ea2e4138acdd8d4ed487049ded35346bca528.tar.gz
spark-c11ea2e4138acdd8d4ed487049ded35346bca528.tar.bz2
spark-c11ea2e4138acdd8d4ed487049ded35346bca528.zip
[MINOR][DOCS] Update build descriptions and commands
## What changes were proposed in this pull request? This PR updates Scala and Hadoop versions in the build description and commands in `Building Spark` documents. ## How was this patch tested? N/A Author: Dongjoon Hyun <dongjoon@apache.org> Closes #11838 from dongjoon-hyun/fix_doc_building_spark.
Diffstat (limited to 'docs/building-spark.md')
-rw-r--r--docs/building-spark.md11
1 files changed, 7 insertions, 4 deletions
diff --git a/docs/building-spark.md b/docs/building-spark.md
index e478954c62..1e202acb9e 100644
--- a/docs/building-spark.md
+++ b/docs/building-spark.md
@@ -98,8 +98,11 @@ mvn -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 -DskipTests clean package
# Apache Hadoop 2.4.X or 2.5.X
mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=VERSION -DskipTests clean package
-Versions of Hadoop after 2.5.X may or may not work with the -Phadoop-2.4 profile (they were
-released after this version of Spark).
+# Apache Hadoop 2.6.X
+mvn -Pyarn -Phadoop-2.6 -Dhadoop.version=2.6.0 -DskipTests clean package
+
+# Apache Hadoop 2.7.X and later
+mvn -Pyarn -Phadoop-2.7 -Dhadoop.version=VERSION -DskipTests clean package
# Different versions of HDFS and YARN.
mvn -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 -Dyarn.version=2.2.0 -DskipTests clean package
@@ -140,10 +143,10 @@ It's possible to build Spark sub-modules using the `mvn -pl` option.
For instance, you can build the Spark Streaming module using:
{% highlight bash %}
-mvn -pl :spark-streaming_2.10 clean install
+mvn -pl :spark-streaming_2.11 clean install
{% endhighlight %}
-where `spark-streaming_2.10` is the `artifactId` as defined in `streaming/pom.xml` file.
+where `spark-streaming_2.11` is the `artifactId` as defined in `streaming/pom.xml` file.
# Continuous Compilation