| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | Move some classes to more appropriate packages: | Matei Zaharia | 2013-09-01 | 1 | -1/+1 |
| | | | | | | | * RDD, *RDDFunctions -> org.apache.spark.rdd * Utils, ClosureCleaner, SizeEstimator -> org.apache.spark.util * JavaSerializer, KryoSerializer -> org.apache.spark.serializer | ||||
| * | Initial work to rename package to org.apache.spark | Matei Zaharia | 2013-09-01 | 2 | -24/+21 |
| | | |||||
| * | Change build and run instructions to use assemblies | Matei Zaharia | 2013-08-29 | 3 | -447/+0 |
| | | | | | | | | | | | | | | | | | This commit makes Spark invocation saner by using an assembly JAR to find all of Spark's dependencies instead of adding all the JARs in lib_managed. It also packages the examples into an assembly and uses that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script with two better-named scripts: "run-examples" for examples, and "spark-class" for Spark internal classes (e.g. REPL, master, etc). This is also designed to minimize the confusion people have in trying to use "run" to run their own classes; it's not meant to do that, but now at least if they look at it, they can modify run-examples to do a decent job for them. As part of this, Bagel's examples are also now properly moved to the examples package instead of bagel. | ||||
| * | Add Apache license headers and LICENSE and NOTICE files | Matei Zaharia | 2013-07-16 | 6 | -1/+103 |
| | | |||||
| * | Attempt to fix streaming test failures after yarn branch merge | Mridul Muralidharan | 2013-04-28 | 1 | -0/+1 |
| | | |||||
| * | Fix passing of superstep in Bagel to avoid seeing new values of the | Matei Zaharia | 2013-04-08 | 1 | -3/+3 |
| | | | | | | superstep value upon recomputation, and set the default storage level in Bagel to MEMORY_AND_DISK | ||||
| * | Fix doc style | Nick Pentreath | 2013-03-11 | 1 | -7/+13 |
| | | |||||
| * | Adding test for non-default persistence level | Nick Pentreath | 2013-03-09 | 1 | -0/+18 |
| | | |||||
| * | Added choice of persitance level to Bagel. Also added documentation. | Nick Pentreath | 2013-03-09 | 1 | -8/+83 |
| | | |||||
| * | Renamed "splits" to "partitions" | Matei Zaharia | 2013-02-17 | 3 | -14/+14 |
| | | |||||
| * | Formatting fixes | Matei Zaharia | 2013-02-11 | 1 | -13/+9 |
| | | |||||
| * | Fixed an exponential recursion that could happen with doCheckpoint due | Matei Zaharia | 2013-02-11 | 1 | -8/+27 |
| | | | | | to lack of memoization | ||||
| * | Replace old 'master' term with 'driver'. | Stephen Haberman | 2013-01-25 | 1 | -1/+1 |
| | | |||||
| * | Changed locations for unit test logs. | Tathagata Das | 2013-01-07 | 1 | -2/+2 |
| | | |||||
| * | Some doc fixes, including showing version number in nav bar again | Matei Zaharia | 2012-10-13 | 1 | -0/+5 |
| | | |||||
| * | More doc updates, and moved Serializer to a subpackage. | Matei Zaharia | 2012-10-12 | 1 | -5/+6 |
| | | |||||
| * | Removed the need to sleep in tests due to waiting for Akka to shut down | Matei Zaharia | 2012-10-07 | 1 | -0/+2 |
| | | |||||
| * | Write all unit test output to a file | Matei Zaharia | 2012-10-01 | 1 | -4/+6 |
| | | |||||
| * | Changed the way tasks' dependency files are sent to workers so that | Matei Zaharia | 2012-09-28 | 1 | -1/+4 |
| | | | | | custom serializers or Kryo registrators can be loaded. | ||||
| * | Set log level in tests to WARN | Matei Zaharia | 2012-08-23 | 1 | -0/+8 |
| | | |||||
| * | Fix further issues with tests and broadcast. | Matei Zaharia | 2012-08-23 | 1 | -1/+4 |
| | | | | | | The broadcast fix is to store values as MEMORY_ONLY_DESER instead of MEMORY_ONLY, which will save substantial time on serialization. | ||||
| * | Stlystic changes | Denny | 2012-07-23 | 1 | -2/+2 |
| | | | | | | | Conflicts: core/src/test/scala/spark/MesosSchedulerSuite.scala | ||||
| * | Always destroy SparkContext in after block for the unit tests. | Denny | 2012-07-23 | 1 | -6/+11 |
| | | | | | | | Conflicts: core/src/test/scala/spark/ShuffleSuite.scala | ||||
| * | Merge branch 'master' into dev | Matei Zaharia | 2012-06-15 | 2 | -3/+1 |
| |\ | |||||
| | * | Performance improvements to shuffle operations: in particular, preserve | Matei Zaharia | 2012-06-09 | 2 | -3/+1 |
| | | | | | | | | | | | RDD partitioning in more cases where it's possible, and use iterators instead of materializing collections when doing joins. | ||||
| * | | Merge in engine improvements from the Spark Streaming project, developed | Matei Zaharia | 2012-06-07 | 1 | -5/+6 |
| |/ | | | | | | jointly with Tathagata Das and Haoyuan Li. This commit imports the changes and ports them to Mesos 0.9, but does not yet pass unit tests due to various classes not supporting a graceful stop() yet. | ||||
| * | Added an option (spark.closure.serializer) to specify the serializer for | Reynold Xin | 2012-04-09 | 1 | -0/+4 |
| | | | | | closures. This enables using Kryo as the closure serializer. | ||||
| * | Update Bagel unit tests to reflect API change | Ankur Dave | 2011-11-08 | 1 | -23/+21 |
| | | |||||
| * | Implement standalone WikipediaPageRank with custom serializer | Ankur Dave | 2011-10-09 | 1 | -0/+198 |
| | | |||||
| * | Update WikipediaPageRank to reflect Bagel API changes | Ankur Dave | 2011-10-09 | 2 | -100/+129 |
| | | |||||
| * | Remove ShortestPath for now | Ankur Dave | 2011-10-09 | 1 | -95/+0 |
| | | |||||
| * | Simplify and genericize type parameters in Bagel | Ankur Dave | 2011-10-09 | 1 | -85/+129 |
| | | |||||
| * | Fix issue #65: Change @serializable to extends Serializable in 2.9 branch | Ismael Juma | 2011-08-02 | 4 | -23/+18 |
| | | | | | | | Note that we use scala.Serializable introduced in Scala 2.9 instead of java.io.Serializable. Also, case classes inherit from scala.Serializable by default. | ||||
| * | Cleaned up a few issues to do with default parallelism levels. Also | Matei Zaharia | 2011-07-14 | 1 | -1/+1 |
| | | | | | | renamed HadoopFileWriter to HadoopWriter (since it's not only for files) and fixed a bug for lookup(). | ||||
| * | Fixed unit tests by making them clean up the SparkContext after use and | Matei Zaharia | 2011-05-13 | 1 | -0/+2 |
| | | | | | | | thus clean up the various singletons (RDDCache, MapOutputTracker, etc). This isn't perfect yet (ideally we shouldn't use singleton objects at all) but we can fix that later. | ||||
| * | Rename bagel to spark.bagel and Pregel to Bagel | Ankur Dave | 2011-05-09 | 4 | -18/+18 |
| | | |||||
| * | Move shortest path and PageRank to bagel.examples | Ankur Dave | 2011-05-03 | 2 | -2/+7 |
| | | |||||
| * | Refactor and add aggregator support | Ankur Dave | 2011-05-03 | 4 | -44/+88 |
| | | | | | | | | | Refactored out the agg() and comp() methods from Pregel.run. Defined an implicit conversion to allow applications that don't use aggregators to avoid including a null argument for the result of the aggregator in the compute function. | ||||
| * | Package combiner functions into a trait | Ankur Dave | 2011-05-03 | 4 | -66/+60 |
| | | |||||
| * | Add Bagel test suite | Ankur Dave | 2011-05-03 | 2 | -0/+65 |
| | | | | | | | Note: This test suite currently fails for the same reason that the Spark Core test suite fails: Spark currently seems to have a bug where any test after the first one fails. | ||||
| * | Clean up Bagel source and interface | Ankur Dave | 2011-05-03 | 3 | -124/+99 |
| | | |||||
| * | Update ShortestPath to work with controllable partitioning | Ankur Dave | 2011-05-03 | 1 | -9/+5 |
| | | |||||
| * | Clean up Pregel.run, add logging | Ankur Dave | 2011-05-03 | 1 | -26/+23 |
| | | |||||
| * | Add Bagel, an implementation of Pregel on Spark | Ankur Dave | 2011-05-03 | 3 | -0/+390 |
 |
index : spark | |
| Mirror of Apache Spark |
| aboutsummaryrefslogtreecommitdiff |