diff options
| author | Marcelo Vanzin <vanzin@cloudera.com> | 2015-04-09 07:07:50 -0400 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-04-09 07:07:50 -0400 |
| commit | 470d7453a56c56a41b2851551fe1830065f88b2c (patch) | |
| tree | 81c4e41c846b312330bfd03beea155333bfb6cd1 /examples/pom.xml | |
| parent | 53f6bb1dfec74cbe8be9ae6a670d82eb6759cc8c (diff) | |
| download | spark-470d7453a56c56a41b2851551fe1830065f88b2c.tar.gz spark-470d7453a56c56a41b2851551fe1830065f88b2c.tar.bz2 spark-470d7453a56c56a41b2851551fe1830065f88b2c.zip | |
[minor] [examples] Avoid packaging duplicate classes.
Add exclusions and explicit dependencies so that the examples
assembly does not duplicate classes already packaged in the main
assembly.
Also avoid relocating the commons-math3 package since it's already
a dependency of spark-core, and thus is already available in the
main assembly.
Author: Marcelo Vanzin <vanzin@cloudera.com>
Closes #5379 from vanzin/examples-deps and squashes the following commits:
12c258e [Marcelo Vanzin] [minor] [examples] Avoid re-packaging unneeded classes.
Diffstat (limited to 'examples/pom.xml')
| -rw-r--r-- | examples/pom.xml | 52 |
1 files changed, 46 insertions, 6 deletions
diff --git a/examples/pom.xml b/examples/pom.xml index 7e93f0eec0..afd7c6d52f 100644 --- a/examples/pom.xml +++ b/examples/pom.xml @@ -90,6 +90,12 @@ <groupId>org.apache.spark</groupId> <artifactId>spark-streaming-zeromq_${scala.binary.version}</artifactId> <version>${project.version}</version> + <exclusions> + <exclusion> + <groupId>org.spark-project.protobuf</groupId> + <artifactId>protobuf-java</artifactId> + </exclusion> + </exclusions> </dependency> <dependency> <groupId>org.apache.hbase</groupId> @@ -234,6 +240,7 @@ <dependency> <groupId>org.apache.commons</groupId> <artifactId>commons-math3</artifactId> + <scope>provided</scope> </dependency> <dependency> <groupId>com.twitter</groupId> @@ -263,6 +270,22 @@ <artifactId>compress-lzf</artifactId> </exclusion> <exclusion> + <groupId>commons-cli</groupId> + <artifactId>commons-cli</artifactId> + </exclusion> + <exclusion> + <groupId>commons-codec</groupId> + <artifactId>commons-codec</artifactId> + </exclusion> + <exclusion> + <groupId>commons-lang</groupId> + <artifactId>commons-lang</artifactId> + </exclusion> + <exclusion> + <groupId>commons-logging</groupId> + <artifactId>commons-logging</artifactId> + </exclusion> + <exclusion> <groupId>io.netty</groupId> <artifactId>netty</artifactId> </exclusion> @@ -271,9 +294,21 @@ <artifactId>jline</artifactId> </exclusion> <exclusion> + <groupId>net.jpountz.lz4</groupId> + <artifactId>lz4</artifactId> + </exclusion> + <exclusion> <groupId>org.apache.cassandra.deps</groupId> <artifactId>avro</artifactId> </exclusion> + <exclusion> + <groupId>org.apache.commons</groupId> + <artifactId>commons-math3</artifactId> + </exclusion> + <exclusion> + <groupId>org.apache.thrift</groupId> + <artifactId>libthrift</artifactId> + </exclusion> </exclusions> </dependency> <dependency> @@ -281,6 +316,17 @@ <artifactId>scopt_${scala.binary.version}</artifactId> <version>3.2.0</version> </dependency> + + <!-- + The following dependencies are already present in the Spark assembly, so we want to force + them to be provided. + --> + <dependency> + <groupId>org.scala-lang</groupId> + <artifactId>scala-library</artifactId> + <scope>provided</scope> + </dependency> + </dependencies> <build> @@ -322,12 +368,6 @@ </excludes> </filter> </filters> - <relocations combine.children="append"> - <relocation> - <pattern>org.apache.commons.math3</pattern> - <shadedPattern>org.spark-project.commons.math3</shadedPattern> - </relocation> - </relocations> <transformers> <transformer implementation="org.apache.maven.plugins.shade.resource.ServicesResourceTransformer" /> <transformer implementation="org.apache.maven.plugins.shade.resource.AppendingTransformer"> |