diff options
| author | Andrew Or <andrewor14@gmail.com> | 2014-05-05 22:14:47 -0700 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-05-05 22:14:47 -0700 |
| commit | a2262cdb7aa30e9f45043f1440d4b02bc3340f9f (patch) | |
| tree | 45cb9ab27c4c11fefe973cb34586178fe8858c5f /sql | |
| parent | 6d721c5f7131f7c9fe56c524133d70cb37f1222d (diff) | |
| download | spark-a2262cdb7aa30e9f45043f1440d4b02bc3340f9f.tar.gz spark-a2262cdb7aa30e9f45043f1440d4b02bc3340f9f.tar.bz2 spark-a2262cdb7aa30e9f45043f1440d4b02bc3340f9f.zip | |
[SPARK-1735] Add the missing special profiles to make-distribution.sh
73b0cbcc241cca3d318ff74340e80b02f884acbd introduced a few special profiles that are not covered in the `make-distribution.sh`. This affects hadoop versions 2.2.x, 2.3.x, and 2.4.x. Without these special profiles, a java version error for protobufs is thrown at run time.
I took the opportunity to rewrite the way we construct the maven command. Previously, the only hadoop version that triggered the `yarn-alpha` profile was 0.23.x, which was inconsistent with the [docs](https://github.com/apache/spark/blob/master/docs/building-with-maven.md). This is now generalized to hadoop versions from 0.23.x to 2.1.x.
Author: Andrew Or <andrewor14@gmail.com>
Closes #660 from andrewor14/hadoop-distribution and squashes the following commits:
6740126 [Andrew Or] Generalize the yarn profile to hadoop versions 2.2+
88f192d [Andrew Or] Add the required special profiles to make-distribution.sh
Diffstat (limited to 'sql')
0 files changed, 0 insertions, 0 deletions