diff options
| author | Bernardo Gomez Palacio <bernardo.gomezpalacio@gmail.com> | 2014-06-08 01:24:52 -0700 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-06-08 01:24:52 -0700 |
| commit | a338834f90556d78119b37985b603ecee85f97ed (patch) | |
| tree | 6e23c3bd8258b5540937080736c1b5adf49e8ff6 /yarn | |
| parent | 7b877b27053bfb7092e250e01a3b887e1b50a109 (diff) | |
| download | spark-a338834f90556d78119b37985b603ecee85f97ed.tar.gz spark-a338834f90556d78119b37985b603ecee85f97ed.tar.bz2 spark-a338834f90556d78119b37985b603ecee85f97ed.zip | |
SPARK-2026: Maven Hadoop Profiles Should Set The Hadoop Version
The Maven Profiles that refer to hadoopX, e.g. `hadoop2.4`, should set the expected
`hadoop.version` and `yarn.version`.
e.g.
```
<profile>
<id>hadoop-2.4</id>
<properties>
<hadoop.version>2.4.0</hadoop.version>
<yarn.version>${hadoop.version}</yarn.version>
<protobuf.version>2.5.0</protobuf.version>
<jets3t.version>0.9.0</jets3t.version>
</properties>
</profile>
```
Builds can still define the `-Dhadoop.version` option but this will correctly default the
Hadoop Version to the one that is expected according the profile that is selected.
e.g.
```$ mvn -P hadoop-2.4,yarn clean install```
or
```$ mvn -P hadoop-0.23,yarn clean install```
[ticket] : https://issues.apache.org/jira/browse/SPARK-2026
Author : berngp
Reviewer : ?
Author: Bernardo Gomez Palacio <bernardo.gomezpalacio@gmail.com>
Closes #998 from berngp/feature/SPARK-2026 and squashes the following commits:
07ba4f7 [Bernardo Gomez Palacio] SPARK-2026: Maven Hadoop Profiles Should Set The Hadoop Version
Diffstat (limited to 'yarn')
0 files changed, 0 insertions, 0 deletions