aboutsummaryrefslogtreecommitdiff
path: root/bagel
Commit message (Collapse)AuthorAgeFilesLines
* Updated versions in the pom.xml files to match current masterThomas Dudziak2012-11-271-1/+1
|
* Addressed code review commentsThomas Dudziak2012-11-271-0/+1
|
* Added maven and debian build filesThomas Dudziak2012-11-201-0/+100
|
* Some doc fixes, including showing version number in nav bar againMatei Zaharia2012-10-131-0/+5
|
* More doc updates, and moved Serializer to a subpackage.Matei Zaharia2012-10-121-5/+6
|
* Removed the need to sleep in tests due to waiting for Akka to shut downMatei Zaharia2012-10-071-0/+2
|
* Write all unit test output to a fileMatei Zaharia2012-10-011-4/+6
|
* Changed the way tasks' dependency files are sent to workers so thatMatei Zaharia2012-09-281-1/+4
| | | | custom serializers or Kryo registrators can be loaded.
* Set log level in tests to WARNMatei Zaharia2012-08-231-0/+8
|
* Fix further issues with tests and broadcast.Matei Zaharia2012-08-231-1/+4
| | | | | The broadcast fix is to store values as MEMORY_ONLY_DESER instead of MEMORY_ONLY, which will save substantial time on serialization.
* Stlystic changesDenny2012-07-231-2/+2
| | | | | | Conflicts: core/src/test/scala/spark/MesosSchedulerSuite.scala
* Always destroy SparkContext in after block for the unit tests.Denny2012-07-231-6/+11
| | | | | | Conflicts: core/src/test/scala/spark/ShuffleSuite.scala
* Merge branch 'master' into devMatei Zaharia2012-06-152-3/+1
|\
| * Performance improvements to shuffle operations: in particular, preserveMatei Zaharia2012-06-092-3/+1
| | | | | | | | | | RDD partitioning in more cases where it's possible, and use iterators instead of materializing collections when doing joins.
* | Merge in engine improvements from the Spark Streaming project, developedMatei Zaharia2012-06-071-5/+6
|/ | | | | | jointly with Tathagata Das and Haoyuan Li. This commit imports the changes and ports them to Mesos 0.9, but does not yet pass unit tests due to various classes not supporting a graceful stop() yet.
* Added an option (spark.closure.serializer) to specify the serializer forReynold Xin2012-04-091-0/+4
| | | | closures. This enables using Kryo as the closure serializer.
* Update Bagel unit tests to reflect API changeAnkur Dave2011-11-081-23/+21
|
* Implement standalone WikipediaPageRank with custom serializerAnkur Dave2011-10-091-0/+198
|
* Update WikipediaPageRank to reflect Bagel API changesAnkur Dave2011-10-092-100/+129
|
* Remove ShortestPath for nowAnkur Dave2011-10-091-95/+0
|
* Simplify and genericize type parameters in BagelAnkur Dave2011-10-091-85/+129
|
* Fix issue #65: Change @serializable to extends Serializable in 2.9 branchIsmael Juma2011-08-024-23/+18
| | | | | | Note that we use scala.Serializable introduced in Scala 2.9 instead of java.io.Serializable. Also, case classes inherit from scala.Serializable by default.
* Cleaned up a few issues to do with default parallelism levels. AlsoMatei Zaharia2011-07-141-1/+1
| | | | | renamed HadoopFileWriter to HadoopWriter (since it's not only for files) and fixed a bug for lookup().
* Fixed unit tests by making them clean up the SparkContext after use andMatei Zaharia2011-05-131-0/+2
| | | | | | thus clean up the various singletons (RDDCache, MapOutputTracker, etc). This isn't perfect yet (ideally we shouldn't use singleton objects at all) but we can fix that later.
* Rename bagel to spark.bagel and Pregel to BagelAnkur Dave2011-05-094-18/+18
|
* Move shortest path and PageRank to bagel.examplesAnkur Dave2011-05-032-2/+7
|
* Refactor and add aggregator supportAnkur Dave2011-05-034-44/+88
| | | | | | | | Refactored out the agg() and comp() methods from Pregel.run. Defined an implicit conversion to allow applications that don't use aggregators to avoid including a null argument for the result of the aggregator in the compute function.
* Package combiner functions into a traitAnkur Dave2011-05-034-66/+60
|
* Add Bagel test suiteAnkur Dave2011-05-032-0/+65
| | | | | | Note: This test suite currently fails for the same reason that the Spark Core test suite fails: Spark currently seems to have a bug where any test after the first one fails.
* Clean up Bagel source and interfaceAnkur Dave2011-05-033-124/+99
|
* Update ShortestPath to work with controllable partitioningAnkur Dave2011-05-031-9/+5
|
* Clean up Pregel.run, add loggingAnkur Dave2011-05-031-26/+23
|
* Add Bagel, an implementation of Pregel on SparkAnkur Dave2011-05-033-0/+390