diff options
| author | Patrick Wendell <pwendell@gmail.com> | 2013-12-06 17:41:27 -0800 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2013-12-06 17:42:28 -0800 |
| commit | bb6e25c663a0fa96552994bcdda2049e9b621db7 (patch) | |
| tree | 21df6d76990b6a50214261e7adea471331f7d7dd /README.md | |
| parent | 241336add5be07fca5ff6c17eed368df7d0c3e3c (diff) | |
| download | spark-bb6e25c663a0fa96552994bcdda2049e9b621db7.tar.gz spark-bb6e25c663a0fa96552994bcdda2049e9b621db7.tar.bz2 spark-bb6e25c663a0fa96552994bcdda2049e9b621db7.zip | |
Minor doc fixes and updating README
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 7 |
1 files changed, 6 insertions, 1 deletions
@@ -55,7 +55,7 @@ versions without YARN, use: # Cloudera CDH 4.2.0 with MapReduce v1 $ SPARK_HADOOP_VERSION=2.0.0-mr1-cdh4.2.0 sbt/sbt assembly -For Apache Hadoop 2.x, 0.23.x, Cloudera CDH MRv2, and other Hadoop versions +For Apache Hadoop 2.0.X, 2.1.X, 0.23.x, Cloudera CDH MRv2, and other Hadoop versions with YARN, also set `SPARK_YARN=true`: # Apache Hadoop 2.0.5-alpha @@ -64,6 +64,11 @@ with YARN, also set `SPARK_YARN=true`: # Cloudera CDH 4.2.0 with MapReduce v2 $ SPARK_HADOOP_VERSION=2.0.0-cdh4.2.0 SPARK_YARN=true sbt/sbt assembly +When building for Hadoop 2.2.X and newer, you'll need to include the additional `new-yarn` profile: + + # Apache Hadoop 2.2.X and newer + $ mvn -Dyarn.version=2.2.0 -Dhadoop.version=2.2.0 -Pnew-yarn + For convenience, these variables may also be set through the `conf/spark-env.sh` file described below. |