diff options
| author | Marcelo Vanzin <vanzin@cloudera.com> | 2016-04-25 10:20:51 -0700 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2016-04-25 10:20:51 -0700 |
| commit | a680562a6f87a03a00f71bad1c424267ae75c641 (patch) | |
| tree | fe08025da6437124c283e9450dd3bbc0e99c411d /pom.xml | |
| parent | bfda09991398ce44be91997252cf8e5ddd361737 (diff) | |
| download | spark-a680562a6f87a03a00f71bad1c424267ae75c641.tar.gz spark-a680562a6f87a03a00f71bad1c424267ae75c641.tar.bz2 spark-a680562a6f87a03a00f71bad1c424267ae75c641.zip | |
[SPARK-14744][EXAMPLES] Clean up examples packaging, remove outdated examples.
First, make all dependencies in the examples module provided, and explicitly
list a couple of ones that somehow are promoted to compile by maven. This
means that to run streaming examples, the streaming connector package needs
to be provided to run-examples using --packages or --jars, just like regular
apps.
Also, remove a couple of outdated examples. HBase has had Spark bindings for
a while and is even including them in the HBase distribution in the next
version, making the examples obsolete. The same applies to Cassandra, which
seems to have a proper Spark binding library already.
I just tested the build, which passes, and ran SparkPi. The examples jars
directory now has only two jars:
```
$ ls -1 examples/target/scala-2.11/jars/
scopt_2.11-3.3.0.jar
spark-examples_2.11-2.0.0-SNAPSHOT.jar
```
Author: Marcelo Vanzin <vanzin@cloudera.com>
Closes #12544 from vanzin/SPARK-14744.
Diffstat (limited to 'pom.xml')
| -rw-r--r-- | pom.xml | 8 |
1 files changed, 1 insertions, 7 deletions
@@ -126,8 +126,6 @@ <hadoop.version>2.2.0</hadoop.version> <protobuf.version>2.5.0</protobuf.version> <yarn.version>${hadoop.version}</yarn.version> - <hbase.version>0.98.17-hadoop2</hbase.version> - <hbase.artifact>hbase</hbase.artifact> <flume.version>1.6.0</flume.version> <zookeeper.version>3.4.5</zookeeper.version> <curator.version>2.4.0</curator.version> @@ -205,7 +203,6 @@ --> <flume.deps.scope>compile</flume.deps.scope> <hadoop.deps.scope>compile</hadoop.deps.scope> - <hbase.deps.scope>compile</hbase.deps.scope> <hive.deps.scope>compile</hive.deps.scope> <parquet.deps.scope>compile</parquet.deps.scope> <parquet.test.deps.scope>test</parquet.test.deps.scope> @@ -739,7 +736,7 @@ <exclusion> <groupId>jline</groupId> <artifactId>jline</artifactId> - </exclusion> + </exclusion> </exclusions> </dependency> <dependency> @@ -2573,9 +2570,6 @@ <id>hadoop-provided</id> </profile> <profile> - <id>hbase-provided</id> - </profile> - <profile> <id>hive-provided</id> </profile> <profile> |