diff options
author | Thomas Graves <tgraves@apache.org> | 2014-05-06 12:00:09 -0700 |
---|---|---|
committer | Patrick Wendell <pwendell@gmail.com> | 2014-05-06 12:00:24 -0700 |
commit | 0c3e4150f6b91f483574ef4d1b7b90d5dd69ec15 (patch) | |
tree | fd869bd48aa3b81d14c0c465cfebd8525dc1dfaf /pom.xml | |
parent | 4ff39292c6d85e5f9a2c4f9164723ddce1f2bdcb (diff) | |
download | spark-0c3e4150f6b91f483574ef4d1b7b90d5dd69ec15.tar.gz spark-0c3e4150f6b91f483574ef4d1b7b90d5dd69ec15.tar.bz2 spark-0c3e4150f6b91f483574ef4d1b7b90d5dd69ec15.zip |
SPARK-1474: Spark on yarn assembly doesn't include AmIpFilter
We use org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter in spark on yarn but are not included it in the assembly jar.
I tested this on yarn cluster by removing the yarn jars from the classpath and spark runs fine now.
Author: Thomas Graves <tgraves@apache.org>
Closes #406 from tgravescs/SPARK-1474 and squashes the following commits:
1548bf9 [Thomas Graves] SPARK-1474: Spark on yarn assembly doesn't include org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
(cherry picked from commit 1e829905c791fbf1dfd8e0c1caa62ead7354605e)
Signed-off-by: Patrick Wendell <pwendell@gmail.com>
Diffstat (limited to 'pom.xml')
-rw-r--r-- | pom.xml | 25 |
1 files changed, 24 insertions, 1 deletions
@@ -616,7 +616,25 @@ </exclusion> </exclusions> </dependency> - + <dependency> + <groupId>org.apache.hadoop</groupId> + <artifactId>hadoop-yarn-server-web-proxy</artifactId> + <version>${yarn.version}</version> + <exclusions> + <exclusion> + <groupId>asm</groupId> + <artifactId>asm</artifactId> + </exclusion> + <exclusion> + <groupId>org.ow2.asm</groupId> + <artifactId>asm</artifactId> + </exclusion> + <exclusion> + <groupId>org.jboss.netty</groupId> + <artifactId>netty</artifactId> + </exclusion> + </exclusions> + </dependency> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-yarn-client</artifactId> @@ -960,6 +978,11 @@ </dependency> <dependency> <groupId>org.apache.hadoop</groupId> + <artifactId>hadoop-yarn-server-web-proxy</artifactId> + <scope>provided</scope> + </dependency> + <dependency> + <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-yarn-client</artifactId> <scope>provided</scope> </dependency> |