aboutsummaryrefslogtreecommitdiff
path: root/bagel
Commit message (Collapse)AuthorAgeFilesLines
...
* Added an option (spark.closure.serializer) to specify the serializer forReynold Xin2012-04-091-0/+4
| | | | closures. This enables using Kryo as the closure serializer.
* Update Bagel unit tests to reflect API changeAnkur Dave2011-11-081-23/+21
|
* Implement standalone WikipediaPageRank with custom serializerAnkur Dave2011-10-091-0/+198
|
* Update WikipediaPageRank to reflect Bagel API changesAnkur Dave2011-10-092-100/+129
|
* Remove ShortestPath for nowAnkur Dave2011-10-091-95/+0
|
* Simplify and genericize type parameters in BagelAnkur Dave2011-10-091-85/+129
|
* Fix issue #65: Change @serializable to extends Serializable in 2.9 branchIsmael Juma2011-08-024-23/+18
| | | | | | Note that we use scala.Serializable introduced in Scala 2.9 instead of java.io.Serializable. Also, case classes inherit from scala.Serializable by default.
* Cleaned up a few issues to do with default parallelism levels. AlsoMatei Zaharia2011-07-141-1/+1
| | | | | renamed HadoopFileWriter to HadoopWriter (since it's not only for files) and fixed a bug for lookup().
* Fixed unit tests by making them clean up the SparkContext after use andMatei Zaharia2011-05-131-0/+2
| | | | | | thus clean up the various singletons (RDDCache, MapOutputTracker, etc). This isn't perfect yet (ideally we shouldn't use singleton objects at all) but we can fix that later.
* Rename bagel to spark.bagel and Pregel to BagelAnkur Dave2011-05-094-18/+18
|
* Move shortest path and PageRank to bagel.examplesAnkur Dave2011-05-032-2/+7
|
* Refactor and add aggregator supportAnkur Dave2011-05-034-44/+88
| | | | | | | | Refactored out the agg() and comp() methods from Pregel.run. Defined an implicit conversion to allow applications that don't use aggregators to avoid including a null argument for the result of the aggregator in the compute function.
* Package combiner functions into a traitAnkur Dave2011-05-034-66/+60
|
* Add Bagel test suiteAnkur Dave2011-05-032-0/+65
| | | | | | Note: This test suite currently fails for the same reason that the Spark Core test suite fails: Spark currently seems to have a bug where any test after the first one fails.
* Clean up Bagel source and interfaceAnkur Dave2011-05-033-124/+99
|
* Update ShortestPath to work with controllable partitioningAnkur Dave2011-05-031-9/+5
|
* Clean up Pregel.run, add loggingAnkur Dave2011-05-031-26/+23
|
* Add Bagel, an implementation of Pregel on SparkAnkur Dave2011-05-033-0/+390