diff options
author | Patrick Wendell <pwendell@gmail.com> | 2014-03-02 15:18:19 -0800 |
---|---|---|
committer | Patrick Wendell <pwendell@gmail.com> | 2014-03-02 15:18:19 -0800 |
commit | c3f5e075335a65ea522b2f76716921ec056c52ed (patch) | |
tree | f4a19d268063a07fbaa63564d67c56cc210beeb4 /core | |
parent | fd31adbf27d824f00f62646e13c23f632d1b77d3 (diff) | |
download | spark-c3f5e075335a65ea522b2f76716921ec056c52ed.tar.gz spark-c3f5e075335a65ea522b2f76716921ec056c52ed.tar.bz2 spark-c3f5e075335a65ea522b2f76716921ec056c52ed.zip |
SPARK-1121: Include avro for yarn-alpha builds
This lets us explicitly include Avro based on a profile for 0.23.X
builds. It makes me sad how convoluted it is to express this logic
in Maven. @tgraves and @sryza curious if this works for you.
I'm also considering just reverting to how it was before. The only
real problem was that Spark advertised a dependency on Avro
even though it only really depends transitively on Avro through
other deps.
Author: Patrick Wendell <pwendell@gmail.com>
Closes #49 from pwendell/avro-build-fix and squashes the following commits:
8d6ee92 [Patrick Wendell] SPARK-1121: Add avro to yarn-alpha profile
Diffstat (limited to 'core')
-rw-r--r-- | core/pom.xml | 14 |
1 files changed, 14 insertions, 0 deletions
diff --git a/core/pom.xml b/core/pom.xml index 2afd250825..99c841472b 100644 --- a/core/pom.xml +++ b/core/pom.xml @@ -31,6 +31,20 @@ <name>Spark Project Core</name> <url>http://spark.apache.org/</url> + <!-- SPARK-1121: SPARK-1121: Adds an explicit dependency on Avro to work around + a Hadoop 0.23.X issue --> + <profiles> + <profile> + <id>yarn-alpha</id> + <dependencies> + <dependency> + <groupId>org.apache.avro</groupId> + <artifactId>avro</artifactId> + </dependency> + </dependencies> + </profile> + </profiles> + <dependencies> <dependency> <groupId>org.apache.hadoop</groupId> |