Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Cleaned up a few issues to do with default parallelism levels. Also | Matei Zaharia | 2011-07-14 | 1 | -1/+1 |
| | | | | | renamed HadoopFileWriter to HadoopWriter (since it's not only for files) and fixed a bug for lookup(). | ||||
* | Fixed unit tests by making them clean up the SparkContext after use and | Matei Zaharia | 2011-05-13 | 1 | -0/+2 |
| | | | | | | thus clean up the various singletons (RDDCache, MapOutputTracker, etc). This isn't perfect yet (ideally we shouldn't use singleton objects at all) but we can fix that later. | ||||
* | Rename bagel to spark.bagel and Pregel to Bagel | Ankur Dave | 2011-05-09 | 4 | -18/+18 |
| | |||||
* | Move shortest path and PageRank to bagel.examples | Ankur Dave | 2011-05-03 | 2 | -2/+7 |
| | |||||
* | Refactor and add aggregator support | Ankur Dave | 2011-05-03 | 4 | -44/+88 |
| | | | | | | | | Refactored out the agg() and comp() methods from Pregel.run. Defined an implicit conversion to allow applications that don't use aggregators to avoid including a null argument for the result of the aggregator in the compute function. | ||||
* | Package combiner functions into a trait | Ankur Dave | 2011-05-03 | 4 | -66/+60 |
| | |||||
* | Add Bagel test suite | Ankur Dave | 2011-05-03 | 2 | -0/+65 |
| | | | | | | Note: This test suite currently fails for the same reason that the Spark Core test suite fails: Spark currently seems to have a bug where any test after the first one fails. | ||||
* | Clean up Bagel source and interface | Ankur Dave | 2011-05-03 | 3 | -124/+99 |
| | |||||
* | Update ShortestPath to work with controllable partitioning | Ankur Dave | 2011-05-03 | 1 | -9/+5 |
| | |||||
* | Clean up Pregel.run, add logging | Ankur Dave | 2011-05-03 | 1 | -26/+23 |
| | |||||
* | Add Bagel, an implementation of Pregel on Spark | Ankur Dave | 2011-05-03 | 3 | -0/+390 |