diff options
| author | Marcelo Vanzin <vanzin@cloudera.com> | 2015-02-27 22:44:11 -0800 |
|---|---|---|
| committer | Patrick Wendell <patrick@databricks.com> | 2015-02-27 22:44:11 -0800 |
| commit | dba08d1fc3bdb9245aefe695970354df088a93b6 (patch) | |
| tree | 48414df88752c63ccd7b6ff4797200b3ef4d33e1 /network | |
| parent | e0e64ba4b1b8eb72e856286f756c65fa22ab0a36 (diff) | |
| download | spark-dba08d1fc3bdb9245aefe695970354df088a93b6.tar.gz spark-dba08d1fc3bdb9245aefe695970354df088a93b6.tar.bz2 spark-dba08d1fc3bdb9245aefe695970354df088a93b6.zip | |
[SPARK-6070] [yarn] Remove unneeded classes from shuffle service jar.
These may conflict with the classes already in the NM. We shouldn't
be repackaging them.
Author: Marcelo Vanzin <vanzin@cloudera.com>
Closes #4820 from vanzin/SPARK-6070 and squashes the following commits:
871b566 [Marcelo Vanzin] The "d'oh how didn't I think of it before" solution.
3cba946 [Marcelo Vanzin] Use profile instead, so that dependencies don't need to be explicitly listed.
7a18a1b [Marcelo Vanzin] [SPARK-6070] [yarn] Remove unneeded classes from shuffle service jar.
Diffstat (limited to 'network')
| -rw-r--r-- | network/yarn/pom.xml | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/network/yarn/pom.xml b/network/yarn/pom.xml index acec8f18f2..39b99f54f6 100644 --- a/network/yarn/pom.xml +++ b/network/yarn/pom.xml @@ -33,6 +33,8 @@ <url>http://spark.apache.org/</url> <properties> <sbt.project.name>network-yarn</sbt.project.name> + <!-- Make sure all Hadoop dependencies are provided to avoid repackaging. --> + <hadoop.deps.scope>provided</hadoop.deps.scope> </properties> <dependencies> @@ -47,7 +49,6 @@ <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-client</artifactId> - <scope>provided</scope> </dependency> </dependencies> |