aboutsummaryrefslogtreecommitdiff
path: root/bagel/src/main
Commit message (Collapse)AuthorAgeFilesLines
* Fix passing of superstep in Bagel to avoid seeing new values of theMatei Zaharia2013-04-081-3/+3
| | | | | superstep value upon recomputation, and set the default storage level in Bagel to MEMORY_AND_DISK
* Fix doc styleNick Pentreath2013-03-111-7/+13
|
* Added choice of persitance level to Bagel. Also added documentation.Nick Pentreath2013-03-091-8/+83
|
* Renamed "splits" to "partitions"Matei Zaharia2013-02-173-14/+14
|
* Formatting fixesMatei Zaharia2013-02-111-13/+9
|
* Some doc fixes, including showing version number in nav bar againMatei Zaharia2012-10-131-0/+5
|
* More doc updates, and moved Serializer to a subpackage.Matei Zaharia2012-10-121-5/+6
|
* Changed the way tasks' dependency files are sent to workers so thatMatei Zaharia2012-09-281-1/+4
| | | | custom serializers or Kryo registrators can be loaded.
* Merge branch 'master' into devMatei Zaharia2012-06-152-3/+1
|\
| * Performance improvements to shuffle operations: in particular, preserveMatei Zaharia2012-06-092-3/+1
| | | | | | | | | | RDD partitioning in more cases where it's possible, and use iterators instead of materializing collections when doing joins.
* | Merge in engine improvements from the Spark Streaming project, developedMatei Zaharia2012-06-071-5/+6
|/ | | | | | jointly with Tathagata Das and Haoyuan Li. This commit imports the changes and ports them to Mesos 0.9, but does not yet pass unit tests due to various classes not supporting a graceful stop() yet.
* Added an option (spark.closure.serializer) to specify the serializer forReynold Xin2012-04-091-0/+4
| | | | closures. This enables using Kryo as the closure serializer.
* Implement standalone WikipediaPageRank with custom serializerAnkur Dave2011-10-091-0/+198
|
* Update WikipediaPageRank to reflect Bagel API changesAnkur Dave2011-10-092-100/+129
|
* Remove ShortestPath for nowAnkur Dave2011-10-091-95/+0
|
* Simplify and genericize type parameters in BagelAnkur Dave2011-10-091-85/+129
|
* Fix issue #65: Change @serializable to extends Serializable in 2.9 branchIsmael Juma2011-08-023-21/+16
| | | | | | Note that we use scala.Serializable introduced in Scala 2.9 instead of java.io.Serializable. Also, case classes inherit from scala.Serializable by default.
* Cleaned up a few issues to do with default parallelism levels. AlsoMatei Zaharia2011-07-141-1/+1
| | | | | renamed HadoopFileWriter to HadoopWriter (since it's not only for files) and fixed a bug for lookup().
* Rename bagel to spark.bagel and Pregel to BagelAnkur Dave2011-05-093-14/+14
|
* Move shortest path and PageRank to bagel.examplesAnkur Dave2011-05-032-2/+7
|
* Refactor and add aggregator supportAnkur Dave2011-05-033-40/+82
| | | | | | | | Refactored out the agg() and comp() methods from Pregel.run. Defined an implicit conversion to allow applications that don't use aggregators to avoid including a null argument for the result of the aggregator in the compute function.
* Package combiner functions into a traitAnkur Dave2011-05-033-58/+58
|
* Add Bagel test suiteAnkur Dave2011-05-031-0/+8
| | | | | | Note: This test suite currently fails for the same reason that the Spark Core test suite fails: Spark currently seems to have a bug where any test after the first one fails.
* Clean up Bagel source and interfaceAnkur Dave2011-05-033-124/+99
|
* Update ShortestPath to work with controllable partitioningAnkur Dave2011-05-031-9/+5
|
* Clean up Pregel.run, add loggingAnkur Dave2011-05-031-26/+23
|
* Add Bagel, an implementation of Pregel on SparkAnkur Dave2011-05-033-0/+390