diff options
| author | Shivaram Venkataraman <shivaram@eecs.berkeley.edu> | 2013-08-06 15:43:46 -0700 |
|---|---|---|
| committer | Shivaram Venkataraman <shivaram@eecs.berkeley.edu> | 2013-08-06 15:43:46 -0700 |
| commit | 471fbadd0c8cb8d310e3e1dd0e694e357ff1233e (patch) | |
| tree | c8710554a0ce04e87873308540757eadfcbbd244 /examples/pom.xml | |
| parent | d2b0f0c23d9ccd5e8a23450e421503d3201f3450 (diff) | |
| download | spark-471fbadd0c8cb8d310e3e1dd0e694e357ff1233e.tar.gz spark-471fbadd0c8cb8d310e3e1dd0e694e357ff1233e.tar.bz2 spark-471fbadd0c8cb8d310e3e1dd0e694e357ff1233e.zip | |
Java examples, tests for KMeans and ALS
- Changes ALS to accept RDD[Rating] instead of (Int, Int, Double) making it
easier to call from Java
- Renames class methods from `train` to `run` to enable static methods to be
called from Java.
- Add unit tests which check if both static / class methods can be called.
- Also add examples which port the main() function in ALS, KMeans to the
examples project.
Couple of minor changes to existing code:
- Add a toJavaRDD method in RDD to convert scala RDD to java RDD easily
- Workaround a bug where using double[] from Java leads to class cast exception in
KMeans init
Diffstat (limited to 'examples/pom.xml')
| -rw-r--r-- | examples/pom.xml | 12 |
1 files changed, 12 insertions, 0 deletions
diff --git a/examples/pom.xml b/examples/pom.xml index 7a8d08fade..ad615b68ff 100644 --- a/examples/pom.xml +++ b/examples/pom.xml @@ -119,6 +119,12 @@ <classifier>hadoop1</classifier> </dependency> <dependency> + <groupId>org.spark-project</groupId> + <artifactId>spark-mllib</artifactId> + <version>${project.version}</version> + <classifier>hadoop1</classifier> + </dependency> + <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-core</artifactId> <scope>provided</scope> @@ -157,6 +163,12 @@ <classifier>hadoop2</classifier> </dependency> <dependency> + <groupId>org.spark-project</groupId> + <artifactId>spark-mllib</artifactId> + <version>${project.version}</version> + <classifier>hadoop2</classifier> + </dependency> + <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-core</artifactId> <scope>provided</scope> |