diff options
| author | Joseph E. Gonzalez <joseph.e.gonzalez@gmail.com> | 2014-06-03 14:14:48 -0700 |
|---|---|---|
| committer | Ankur Dave <ankurdave@gmail.com> | 2014-06-03 14:14:48 -0700 |
| commit | 894ecde04faa7e2054a40825a58b2e9cdaa93c70 (patch) | |
| tree | cce968cd69ec52aaeb37a8930809d3757a3f975f /project | |
| parent | aa41a522d821c989c65fa3f7f2a4d372e39bb958 (diff) | |
| download | spark-894ecde04faa7e2054a40825a58b2e9cdaa93c70.tar.gz spark-894ecde04faa7e2054a40825a58b2e9cdaa93c70.tar.bz2 spark-894ecde04faa7e2054a40825a58b2e9cdaa93c70.zip | |
Synthetic GraphX Benchmark
This PR accomplishes two things:
1. It introduces a Synthetic Benchmark application that generates an arbitrarily large log-normal graph and executes either PageRank or connected components on the graph. This can be used to profile GraphX system on arbitrary clusters without access to large graph datasets
2. This PR improves the implementation of the log-normal graph generator.
Author: Joseph E. Gonzalez <joseph.e.gonzalez@gmail.com>
Author: Ankur Dave <ankurdave@gmail.com>
Closes #720 from jegonzal/graphx_synth_benchmark and squashes the following commits:
e40812a [Ankur Dave] Exclude all of GraphX from compatibility checks vs. 1.0.0
bccccad [Ankur Dave] Fix long lines
374678a [Ankur Dave] Bugfix and style changes
1bdf39a [Joseph E. Gonzalez] updating options
d943972 [Joseph E. Gonzalez] moving the benchmark application into the examples folder.
f4f839a [Joseph E. Gonzalez] Creating a synthetic benchmark script.
Diffstat (limited to 'project')
| -rw-r--r-- | project/MimaExcludes.scala | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index ecb389de55..fc9cbeaec6 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -35,7 +35,8 @@ object MimaExcludes { val excludes = SparkBuild.SPARK_VERSION match { case v if v.startsWith("1.1") => - Seq() + Seq( + MimaBuild.excludeSparkPackage("graphx")) case v if v.startsWith("1.0") => Seq( MimaBuild.excludeSparkPackage("api.java"), @@ -58,4 +59,3 @@ object MimaExcludes { case _ => Seq() } } - |