diff options
| author | Yves Raimond <yraimond@netflix.com> | 2016-09-10 00:15:59 -0700 |
|---|---|---|
| committer | DB Tsai <dbt@netflix.com> | 2016-09-10 00:15:59 -0700 |
| commit | 1fec3ce4e19664aa9f9238d9491b0cb1511f9be1 (patch) | |
| tree | 8e28cb476c00c8c0f14523b064ffcb3bf5806b8e /graphx/pom.xml | |
| parent | 335491704c526921da3b3c5035175677ba5b92de (diff) | |
| download | spark-1fec3ce4e19664aa9f9238d9491b0cb1511f9be1.tar.gz spark-1fec3ce4e19664aa9f9238d9491b0cb1511f9be1.tar.bz2 spark-1fec3ce4e19664aa9f9238d9491b0cb1511f9be1.zip | |
[SPARK-11496][GRAPHX] Parallel implementation of personalized pagerank
(Updated version of [PR-9457](https://github.com/apache/spark/pull/9457), rebased on latest Spark master, and using mllib-local).
This implements a parallel version of personalized pagerank, which runs all propagations for a list of source vertices in parallel.
I ran a few benchmarks on the full [DBpedia](http://dbpedia.org/) graph. When running personalized pagerank for only one source node, the existing implementation is twice as fast as the parallel one (because of the SparseVector overhead). However for 10 source nodes, the parallel implementation is four times as fast. When increasing the number of source nodes, this difference becomes even greater.
Author: Yves Raimond <yraimond@netflix.com>
Closes #14998 from moustaki/parallel-ppr.
Diffstat (limited to 'graphx/pom.xml')
| -rw-r--r-- | graphx/pom.xml | 5 |
1 files changed, 5 insertions, 0 deletions
diff --git a/graphx/pom.xml b/graphx/pom.xml index bd4e53371b..10d5ba93eb 100644 --- a/graphx/pom.xml +++ b/graphx/pom.xml @@ -47,6 +47,11 @@ <scope>test</scope> </dependency> <dependency> + <groupId>org.apache.spark</groupId> + <artifactId>spark-mllib-local_${scala.binary.version}</artifactId> + <version>${project.version}</version> + </dependency> + <dependency> <groupId>org.apache.xbean</groupId> <artifactId>xbean-asm5-shaded</artifactId> </dependency> |