diff options
| author | Patrick Wendell <pwendell@gmail.com> | 2014-03-02 15:18:19 -0800 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-03-02 15:18:19 -0800 |
| commit | c3f5e075335a65ea522b2f76716921ec056c52ed (patch) | |
| tree | f4a19d268063a07fbaa63564d67c56cc210beeb4 /docs | |
| parent | fd31adbf27d824f00f62646e13c23f632d1b77d3 (diff) | |
| download | spark-c3f5e075335a65ea522b2f76716921ec056c52ed.tar.gz spark-c3f5e075335a65ea522b2f76716921ec056c52ed.tar.bz2 spark-c3f5e075335a65ea522b2f76716921ec056c52ed.zip | |
SPARK-1121: Include avro for yarn-alpha builds
This lets us explicitly include Avro based on a profile for 0.23.X
builds. It makes me sad how convoluted it is to express this logic
in Maven. @tgraves and @sryza curious if this works for you.
I'm also considering just reverting to how it was before. The only
real problem was that Spark advertised a dependency on Avro
even though it only really depends transitively on Avro through
other deps.
Author: Patrick Wendell <pwendell@gmail.com>
Closes #49 from pwendell/avro-build-fix and squashes the following commits:
8d6ee92 [Patrick Wendell] SPARK-1121: Add avro to yarn-alpha profile
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/building-with-maven.md | 4 |
1 files changed, 0 insertions, 4 deletions
diff --git a/docs/building-with-maven.md b/docs/building-with-maven.md index 40cac8eb4f..ded1292688 100644 --- a/docs/building-with-maven.md +++ b/docs/building-with-maven.md @@ -76,7 +76,3 @@ The maven build includes support for building a Debian package containing the as $ mvn -Pdeb -DskipTests clean package The debian package can then be found under assembly/target. We added the short commit hash to the file name so that we can distinguish individual packages built for SNAPSHOT versions. - -## A note about Hadoop version 0.23.x - -For building spark with hadoop 0.23.x and also yarn, you will have to manually add a dependency on avro (org.apache.avro, avro, 1.7.4). |