Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | | | | | | | | | | | | | | | Removed the need to sleep in tests due to waiting for Akka to shut down | Matei Zaharia | 2012-10-07 | 17 | -23/+44 | |
|/ / / / / / / / / / / / / / | ||||||
* | | | | | | | | | | | | | | Log message | Matei Zaharia | 2012-10-07 | 1 | -1/+1 | |
| | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | More logging | Matei Zaharia | 2012-10-07 | 1 | -4/+7 | |
| | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | Log more info in MapOutputTracker | root | 2012-10-07 | 1 | -4/+7 | |
| | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | Made Akka thread pool and message batch sizes configurable | root | 2012-10-07 | 1 | -3/+5 | |
| | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | Made run script add test-classes onto the classpath only if SPARK_TESTING is ↵ | root | 2012-10-07 | 5 | -5/+11 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | set; fixes #216 | |||||
* | | | | | | | | | | | | | | Avoid acquiring locks in BlockManager when fetching shuffle outputs | root | 2012-10-07 | 1 | -0/+24 | |
| | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | Log initial number of fetches in reducer | root | 2012-10-07 | 1 | -1/+2 | |
| | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | Modified shuffle to limit the maximum outstanding data size in bytes, | Matei Zaharia | 2012-10-06 | 5 | -64/+114 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | instead of the maximum number of outstanding fetches. This should make it faster when there are many small map output files, as well as more robust to overallocating memory on large map outputs. | |||||
* | | | | | | | | | | | | | | Pass sizes of map outputs back to MapOutputTracker | Matei Zaharia | 2012-10-06 | 9 | -83/+152 | |
| | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | Made block store return the size of each block put in | Matei Zaharia | 2012-10-06 | 6 | -36/+70 | |
| | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | Warn about user programs that try to set spark.cache.class | Matei Zaharia | 2012-10-06 | 1 | -1/+7 | |
| | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | Only group elements ten at a time into SequenceFile records in | Matei Zaharia | 2012-10-06 | 1 | -2/+2 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | saveAsObjectFile | |||||
* | | | | | | | | | | | | | | Minor formatting fixes | Matei Zaharia | 2012-10-05 | 3 | -3/+2 | |
| | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | Merge branch 'dev' of github.com:mesos/spark into dev | Matei Zaharia | 2012-10-05 | 25 | -99/+228 | |
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ | ||||||
| * \ \ \ \ \ \ \ \ \ \ \ \ \ | Merge pull request #249 from andyk/move-rdds-to-their-own-package | Matei Zaharia | 2012-10-05 | 25 | -99/+228 | |
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Move RDD classes/files to their own package/directory | |||||
| | * | | | | | | | | | | | | | | Factor subclasses of RDD out of RDD.scala into their own classes | Andy Konwinski | 2012-10-05 | 8 | -66/+106 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | in the rdd package. | |||||
| | * | | | | | | | | | | | | | | Moves all files in core/src/main/scala/ that have RDD in their name | Andy Konwinski | 2012-10-05 | 13 | -0/+0 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | from that directory to a new core/src/main/scala/rdd directory. | |||||
| | * | | | | | | | | | | | | | | Moves all files in core/src/main/scala/ that have RDD in them from | Andy Konwinski | 2012-10-05 | 18 | -33/+122 | |
| |/ / / / / / / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | package spark to package spark.rdd and updates all references to them. | |||||
* / / / / / / / / / / / / / / | Cleaning up code slightly | Matei Zaharia | 2012-10-05 | 2 | -3/+3 | |
|/ / / / / / / / / / / / / / | ||||||
* | | | | | | | | | | | | | | Reduce some overly aggressive logging in connection manager | root | 2012-10-06 | 2 | -9/+7 | |
| | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | Links quick start from nav bar | Matei Zaharia | 2012-10-05 | 1 | -0/+1 | |
| | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | Fix SizeEstimator tests to work with String classes in JDK 6 and 7 | Shivaram Venkataraman | 2012-10-05 | 2 | -12/+29 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/test/scala/spark/BoundedMemoryCacheSuite.scala | |||||
* | | | | | | | | | | | | | | Merge pull request #247 from squito/dev | Matei Zaharia | 2012-10-05 | 2 | -1/+26 | |
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Dev | |||||
| * | | | | | | | | | | | | | | change tests to show utility of localValue | Imran Rashid | 2012-10-04 | 2 | -4/+5 | |
| | | | | | | | | | | | | | | | ||||||
| * | | | | | | | | | | | | | | make accumulator.localValue public, add tests | Imran Rashid | 2012-10-04 | 2 | -1/+25 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/test/scala/spark/AccumulatorSuite.scala | |||||
* | | | | | | | | | | | | | | | Scaladoc documentation for some core Spark functionality | Matei Zaharia | 2012-10-04 | 4 | -70/+180 | |
| | | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | | Merge branch 'dev' of github.com:mesos/spark into dev | Matei Zaharia | 2012-10-04 | 1 | -7/+12 | |
|\| | | | | | | | | | | | | | | ||||||
| * | | | | | | | | | | | | | | Merge pull request #245 from pwendell/mem_tuning | Matei Zaharia | 2012-10-03 | 1 | -7/+12 | |
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Some additions to the Tuning Guide. | |||||
| | * | | | | | | | | | | | | | | Some additions to the Tuning Guide. | Patrick Wendell | 2012-10-03 | 1 | -7/+12 | |
| |/ / / / / / / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 1. Slight change in organization 2. Added pre-requisites 3. Made a new section about determining memory footprint of an RDD 4. Other small changes | |||||
* / / / / / / / / / / / / / / | Don't check for JARs in core/lib anymore | Matei Zaharia | 2012-10-04 | 2 | -5/+1 | |
|/ / / / / / / / / / / / / / | ||||||
* | | | | | | | | | | | | | | Merge pull request #243 from andyk/mesos-from-maven-central | Matei Zaharia | 2012-10-03 | 2 | -1/+2 | |
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Removes the included mesos-0.9.0.jar and pulls it from Maven Central instead | |||||
| * | | | | | | | | | | | | | | Removes the included mesos-0.9.0.jar and adds a libraryDependency to | Andy Konwinski | 2012-10-03 | 2 | -1/+2 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | the build file so that mesos-0.9.0-incubating.jar (which contains the same class files, but has a silightly different name) will be pulled down from Maven Central instead. | |||||
* | | | | | | | | | | | | | | | Merge pull request #244 from rxin/dev | Reynold Xin | 2012-10-03 | 2 | -4/+4 | |
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | |/ / / / / / / / / / / / / / |/| | | | | | | | | | | | | | | Made Serializer and JavaSerializer non private. | |||||
| * | | | | | | | | | | | | | | Made Serializer and JavaSerializer non private. | Reynold Xin | 2012-10-03 | 2 | -4/+4 | |
|/ / / / / / / / / / / / / / | ||||||
* | | | | | | | | | | | | | | Merge pull request #236 from pwendell/quickstart | Matei Zaharia | 2012-10-03 | 2 | -0/+243 | |
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | A Spark "Quick Start" example | |||||
| * | | | | | | | | | | | | | | Responding to Matei's comments | Patrick Wendell | 2012-10-02 | 2 | -101/+57 | |
| | | | | | | | | | | | | | | | ||||||
| * | | | | | | | | | | | | | | A Spark "Quick Start" example | Patrick Wendell | 2012-10-01 | 3 | -0/+287 | |
| | |_|_|_|_|_|_|_|_|_|_|/ / | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit includes a quick start example that covers: 1) Basic usage of the Spark shell 2) A simple Spark job in Scala 3) A simple Spark job in Java | |||||
* | | | | | | | | | | | | | | Made StorageLevel public | Matei Zaharia | 2012-10-03 | 1 | -2/+2 | |
| | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | Make more stuff private[spark] | Matei Zaharia | 2012-10-02 | 6 | -4/+11 | |
| |_|_|_|_|_|_|_|_|_|_|_|/ |/| | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | Simplify README even further | Matei Zaharia | 2012-10-02 | 1 | -4/+2 | |
| | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | Merge pull request #242 from pwendell/readme-update | Matei Zaharia | 2012-10-02 | 1 | -1/+1 | |
|\ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Changing version of Scala in README | |||||
| * | | | | | | | | | | | | | Changing version of Scala in README | Patrick Wendell | 2012-10-02 | 1 | -1/+1 | |
| | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | Merge pull request #241 from shivaram/tuning-doc | Matei Zaharia | 2012-10-02 | 1 | -5/+63 | |
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | First cut at adding documentation for GC tuning | |||||
| * | | | | | | | | | | | | | | First cut at adding documentation for GC tuning | Shivaram Venkataraman | 2012-10-02 | 1 | -5/+63 | |
| | | | | | | | | | | | | | | | ||||||
* | | | | | | | | | | | | | | | Merge pull request #240 from dennybritz/private_classes | Matei Zaharia | 2012-10-02 | 117 | -186/+243 | |
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | |/ / / / / / / / / / / / / / |/| | | | | | | | | | | | | | | Package-Private Classes | |||||
| * | | | | | | | | | | | | | | Make Java API abstract wrapped functions private | Denny | 2012-10-02 | 2 | -2/+2 | |
| | | | | | | | | | | | | | | | ||||||
| * | | | | | | | | | | | | | | accidentially removed trait | Denny | 2012-10-02 | 1 | -1/+1 | |
| | | | | | | | | | | | | | | | ||||||
| * | | | | | | | | | | | | | | Stylistic changes and Public Accumulable and Broadcast | Denny | 2012-10-02 | 30 | -59/+117 | |
| | | | | | | | | | | | | | | | ||||||
| * | | | | | | | | | | | | | | Make dependency classes public - used by spark | Denny | 2012-10-02 | 1 | -5/+5 | |
| | | | | | | | | | | | | | | |