diff options
| author | medale <medale94@yahoo.com> | 2015-02-08 10:35:29 +0000 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-02-08 10:35:40 +0000 |
| commit | bc55e20fd5df7eb5254df2206ca4f1469750e6c9 (patch) | |
| tree | 401e8a06723fcafbf195ff1b1731deeca30683f5 /pom.xml | |
| parent | 96010faa318a822b3a8d6153ca4c1541a384cc34 (diff) | |
| download | spark-bc55e20fd5df7eb5254df2206ca4f1469750e6c9.tar.gz spark-bc55e20fd5df7eb5254df2206ca4f1469750e6c9.tar.bz2 spark-bc55e20fd5df7eb5254df2206ca4f1469750e6c9.zip | |
[SPARK-3039] [BUILD] Spark assembly for new hadoop API (hadoop 2) contai...
...ns avro-mapred for
hadoop 1 API had been marked as resolved but did not work for at least some
builds due to version conflicts using avro-mapred-1.7.5.jar and
avro-mapred-1.7.6-hadoop2.jar (the correct version) when building for hadoop2.
sql/hive/pom.xml org.spark-project.hive:hive-exec's depends on 1.7.5:
Building Spark Project Hive 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-dependency-plugin:2.4:tree (default-cli) spark-hive_2.10 ---
[INFO] org.apache.spark:spark-hive_2.10:jar:1.2.0
[INFO] +- org.spark-project.hive:hive-exec:jar:0.13.1a:compile
[INFO] | \- org.apache.avro:avro-mapred:jar:1.7.5:compile
[INFO] \- org.apache.avro:avro-mapred:jar:hadoop2:1.7.6:compile
[INFO]
Excluding this dependency allows the explicitly listed avro-mapred dependency
to be picked up.
Author: medale <medale94@yahoo.com>
Closes #4315 from medale/avro-hadoop2 and squashes the following commits:
1ab4fa3 [medale] Merge branch 'master' into avro-hadoop2
9d85e2a [medale] Merge remote-tracking branch 'upstream/master' into avro-hadoop2
51b9c2a [medale] [SPARK-3039] [BUILD] Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for hadoop 1 API had been marked as resolved but did not work for at least some builds due to version conflicts using avro-mapred-1.7.5.jar and avro-mapred-1.7.6-hadoop2.jar (the correct version) when building for hadoop2.
(cherry picked from commit 75fdccca32972f86a975033d7c4ce576dd79290f)
Signed-off-by: Sean Owen <sowen@cloudera.com>
Diffstat (limited to 'pom.xml')
| -rw-r--r-- | pom.xml | 4 |
1 files changed, 4 insertions, 0 deletions
@@ -975,6 +975,10 @@ <groupId>com.esotericsoftware.kryo</groupId> <artifactId>kryo</artifactId> </exclusion> + <exclusion> + <groupId>org.apache.avro</groupId> + <artifactId>avro-mapred</artifactId> + </exclusion> </exclusions> </dependency> <dependency> |