diff options
| author | Sandy Ryza <sandy@cloudera.com> | 2014-11-24 13:28:48 -0600 |
|---|---|---|
| committer | Thomas Graves <tgraves@apache.org> | 2014-11-24 13:29:01 -0600 |
| commit | 1a12ca339cf038c44f5d7402d63851f48a055b35 (patch) | |
| tree | ec0ddbb5e6a46fe5c8456d2cd66d1d5c5191c754 /docs | |
| parent | 4b68cabf5894643deb99042268fb5b343e8d31f3 (diff) | |
| download | spark-1a12ca339cf038c44f5d7402d63851f48a055b35.tar.gz spark-1a12ca339cf038c44f5d7402d63851f48a055b35.tar.bz2 spark-1a12ca339cf038c44f5d7402d63851f48a055b35.zip | |
SPARK-4457. Document how to build for Hadoop versions greater than 2.4
Author: Sandy Ryza <sandy@cloudera.com>
Closes #3322 from sryza/sandy-spark-4457 and squashes the following commits:
5e72b77 [Sandy Ryza] Feedback
0cf05c1 [Sandy Ryza] Caveat
be8084b [Sandy Ryza] SPARK-4457. Document how to build for Hadoop versions greater than 2.4
(cherry picked from commit 29372b63185a4a170178b6ec2362d7112f389852)
Signed-off-by: Thomas Graves <tgraves@apache.org>
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/building-spark.md | 7 |
1 files changed, 5 insertions, 2 deletions
diff --git a/docs/building-spark.md b/docs/building-spark.md index bb18414092..fee6a84406 100644 --- a/docs/building-spark.md +++ b/docs/building-spark.md @@ -92,8 +92,11 @@ mvn -Pyarn -Phadoop-2.2 -Dhadoop.version=2.2.0 -DskipTests clean package # Apache Hadoop 2.3.X mvn -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 -DskipTests clean package -# Apache Hadoop 2.4.X -mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -DskipTests clean package +# Apache Hadoop 2.4.X or 2.5.X +mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=VERSION -DskipTests clean package + +Versions of Hadoop after 2.5.X may or may not work with the -Phadoop-2.4 profile (they were +released after this version of Spark). # Different versions of HDFS and YARN. mvn -Pyarn-alpha -Phadoop-2.3 -Dhadoop.version=2.3.0 -Dyarn.version=0.23.7 -DskipTests clean package |