diff options
| author | Sandy Ryza <sandy@cloudera.com> | 2014-11-24 13:28:48 -0600 |
|---|---|---|
| committer | Thomas Graves <tgraves@apache.org> | 2014-11-24 13:28:48 -0600 |
| commit | 29372b63185a4a170178b6ec2362d7112f389852 (patch) | |
| tree | 6197c83a9e291cb17410a98556cb854b4b94140e /docs/building-spark.md | |
| parent | 9b2a3c6126e4fe8485e506f8a56a26cb72509a5f (diff) | |
| download | spark-29372b63185a4a170178b6ec2362d7112f389852.tar.gz spark-29372b63185a4a170178b6ec2362d7112f389852.tar.bz2 spark-29372b63185a4a170178b6ec2362d7112f389852.zip | |
SPARK-4457. Document how to build for Hadoop versions greater than 2.4
Author: Sandy Ryza <sandy@cloudera.com>
Closes #3322 from sryza/sandy-spark-4457 and squashes the following commits:
5e72b77 [Sandy Ryza] Feedback
0cf05c1 [Sandy Ryza] Caveat
be8084b [Sandy Ryza] SPARK-4457. Document how to build for Hadoop versions greater than 2.4
Diffstat (limited to 'docs/building-spark.md')
| -rw-r--r-- | docs/building-spark.md | 7 |
1 files changed, 5 insertions, 2 deletions
diff --git a/docs/building-spark.md b/docs/building-spark.md index bb18414092..fee6a84406 100644 --- a/docs/building-spark.md +++ b/docs/building-spark.md @@ -92,8 +92,11 @@ mvn -Pyarn -Phadoop-2.2 -Dhadoop.version=2.2.0 -DskipTests clean package # Apache Hadoop 2.3.X mvn -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 -DskipTests clean package -# Apache Hadoop 2.4.X -mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -DskipTests clean package +# Apache Hadoop 2.4.X or 2.5.X +mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=VERSION -DskipTests clean package + +Versions of Hadoop after 2.5.X may or may not work with the -Phadoop-2.4 profile (they were +released after this version of Spark). # Different versions of HDFS and YARN. mvn -Pyarn-alpha -Phadoop-2.3 -Dhadoop.version=2.3.0 -Dyarn.version=0.23.7 -DskipTests clean package |