diff options
Diffstat (limited to 'docs/building-spark.md')
| -rw-r--r-- | docs/building-spark.md | 11 |
1 files changed, 7 insertions, 4 deletions
diff --git a/docs/building-spark.md b/docs/building-spark.md index e478954c62..1e202acb9e 100644 --- a/docs/building-spark.md +++ b/docs/building-spark.md @@ -98,8 +98,11 @@ mvn -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 -DskipTests clean package # Apache Hadoop 2.4.X or 2.5.X mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=VERSION -DskipTests clean package -Versions of Hadoop after 2.5.X may or may not work with the -Phadoop-2.4 profile (they were -released after this version of Spark). +# Apache Hadoop 2.6.X +mvn -Pyarn -Phadoop-2.6 -Dhadoop.version=2.6.0 -DskipTests clean package + +# Apache Hadoop 2.7.X and later +mvn -Pyarn -Phadoop-2.7 -Dhadoop.version=VERSION -DskipTests clean package # Different versions of HDFS and YARN. mvn -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 -Dyarn.version=2.2.0 -DskipTests clean package @@ -140,10 +143,10 @@ It's possible to build Spark sub-modules using the `mvn -pl` option. For instance, you can build the Spark Streaming module using: {% highlight bash %} -mvn -pl :spark-streaming_2.10 clean install +mvn -pl :spark-streaming_2.11 clean install {% endhighlight %} -where `spark-streaming_2.10` is the `artifactId` as defined in `streaming/pom.xml` file. +where `spark-streaming_2.11` is the `artifactId` as defined in `streaming/pom.xml` file. # Continuous Compilation |