diff options
| author | Bernardo Gomez Palacio <bernardo.gomezpalacio@gmail.com> | 2014-06-08 01:24:52 -0700 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-06-08 01:24:52 -0700 |
| commit | a338834f90556d78119b37985b603ecee85f97ed (patch) | |
| tree | 6e23c3bd8258b5540937080736c1b5adf49e8ff6 /pom.xml | |
| parent | 7b877b27053bfb7092e250e01a3b887e1b50a109 (diff) | |
| download | spark-a338834f90556d78119b37985b603ecee85f97ed.tar.gz spark-a338834f90556d78119b37985b603ecee85f97ed.tar.bz2 spark-a338834f90556d78119b37985b603ecee85f97ed.zip | |
SPARK-2026: Maven Hadoop Profiles Should Set The Hadoop Version
The Maven Profiles that refer to hadoopX, e.g. `hadoop2.4`, should set the expected
`hadoop.version` and `yarn.version`.
e.g.
```
<profile>
<id>hadoop-2.4</id>
<properties>
<hadoop.version>2.4.0</hadoop.version>
<yarn.version>${hadoop.version}</yarn.version>
<protobuf.version>2.5.0</protobuf.version>
<jets3t.version>0.9.0</jets3t.version>
</properties>
</profile>
```
Builds can still define the `-Dhadoop.version` option but this will correctly default the
Hadoop Version to the one that is expected according the profile that is selected.
e.g.
```$ mvn -P hadoop-2.4,yarn clean install```
or
```$ mvn -P hadoop-0.23,yarn clean install```
[ticket] : https://issues.apache.org/jira/browse/SPARK-2026
Author : berngp
Reviewer : ?
Author: Bernardo Gomez Palacio <bernardo.gomezpalacio@gmail.com>
Closes #998 from berngp/feature/SPARK-2026 and squashes the following commits:
07ba4f7 [Bernardo Gomez Palacio] SPARK-2026: Maven Hadoop Profiles Should Set The Hadoop Version
Diffstat (limited to 'pom.xml')
| -rw-r--r-- | pom.xml | 10 |
1 files changed, 8 insertions, 2 deletions
@@ -209,14 +209,14 @@ <repository> <id>spring-releases</id> <name>Spring Release Repository</name> - <url>http://repo.spring.io/libs-release</url> + <url>http://repo.spring.io/libs-release</url> <releases> <enabled>true</enabled> </releases> <snapshots> <enabled>false</enabled> </snapshots> - </repository> + </repository> </repositories> <dependencyManagement> @@ -987,11 +987,15 @@ <artifactId>avro</artifactId> </dependency> </dependencies> + <properties> + <hadoop.version>0.23.10</hadoop.version> + </properties> </profile> <profile> <id>hadoop-2.2</id> <properties> + <hadoop.version>2.2.0</hadoop.version> <protobuf.version>2.5.0</protobuf.version> </properties> </profile> @@ -999,6 +1003,7 @@ <profile> <id>hadoop-2.3</id> <properties> + <hadoop.version>2.3.0</hadoop.version> <protobuf.version>2.5.0</protobuf.version> <jets3t.version>0.9.0</jets3t.version> </properties> @@ -1007,6 +1012,7 @@ <profile> <id>hadoop-2.4</id> <properties> + <hadoop.version>2.4.0</hadoop.version> <protobuf.version>2.5.0</protobuf.version> <jets3t.version>0.9.0</jets3t.version> </properties> |