diff options
| author | Patrick Wendell <pwendell@gmail.com> | 2014-03-02 15:18:19 -0800 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-03-02 15:18:19 -0800 |
| commit | c3f5e075335a65ea522b2f76716921ec056c52ed (patch) | |
| tree | f4a19d268063a07fbaa63564d67c56cc210beeb4 /external/flume/pom.xml | |
| parent | fd31adbf27d824f00f62646e13c23f632d1b77d3 (diff) | |
| download | spark-c3f5e075335a65ea522b2f76716921ec056c52ed.tar.gz spark-c3f5e075335a65ea522b2f76716921ec056c52ed.tar.bz2 spark-c3f5e075335a65ea522b2f76716921ec056c52ed.zip | |
SPARK-1121: Include avro for yarn-alpha builds
This lets us explicitly include Avro based on a profile for 0.23.X
builds. It makes me sad how convoluted it is to express this logic
in Maven. @tgraves and @sryza curious if this works for you.
I'm also considering just reverting to how it was before. The only
real problem was that Spark advertised a dependency on Avro
even though it only really depends transitively on Avro through
other deps.
Author: Patrick Wendell <pwendell@gmail.com>
Closes #49 from pwendell/avro-build-fix and squashes the following commits:
8d6ee92 [Patrick Wendell] SPARK-1121: Add avro to yarn-alpha profile
Diffstat (limited to 'external/flume/pom.xml')
| -rw-r--r-- | external/flume/pom.xml | 14 |
1 files changed, 14 insertions, 0 deletions
diff --git a/external/flume/pom.xml b/external/flume/pom.xml index bc00ab4573..8783aea3e4 100644 --- a/external/flume/pom.xml +++ b/external/flume/pom.xml @@ -31,6 +31,20 @@ <name>Spark Project External Flume</name> <url>http://spark.apache.org/</url> + <profiles> + <profile> + <!-- SPARK-1121: SPARK-1121: Adds an explicit dependency on Avro to work around + a Hadoop 0.23.X issue --> + <id>yarn-alpha</id> + <dependencies> + <dependency> + <groupId>org.apache.avro</groupId> + <artifactId>avro</artifactId> + </dependency> + </dependencies> + </profile> + </profiles> + <dependencies> <dependency> <groupId>org.apache.spark</groupId> |