aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
* | | | | | | | | | | | | | | Removed the need to sleep in tests due to waiting for Akka to shut downMatei Zaharia2012-10-0717-23/+44
|/ / / / / / / / / / / / / /
* | | | | | | | | | | | | | Log messageMatei Zaharia2012-10-071-1/+1
| | | | | | | | | | | | | |
* | | | | | | | | | | | | | More loggingMatei Zaharia2012-10-071-4/+7
| | | | | | | | | | | | | |
* | | | | | | | | | | | | | Log more info in MapOutputTrackerroot2012-10-071-4/+7
| | | | | | | | | | | | | |
* | | | | | | | | | | | | | Made Akka thread pool and message batch sizes configurableroot2012-10-071-3/+5
| | | | | | | | | | | | | |
* | | | | | | | | | | | | | Made run script add test-classes onto the classpath only if SPARK_TESTING is ↵root2012-10-075-5/+11
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | set; fixes #216
* | | | | | | | | | | | | | Avoid acquiring locks in BlockManager when fetching shuffle outputsroot2012-10-071-0/+24
| | | | | | | | | | | | | |
* | | | | | | | | | | | | | Log initial number of fetches in reducerroot2012-10-071-1/+2
| | | | | | | | | | | | | |
* | | | | | | | | | | | | | Modified shuffle to limit the maximum outstanding data size in bytes,Matei Zaharia2012-10-065-64/+114
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | instead of the maximum number of outstanding fetches. This should make it faster when there are many small map output files, as well as more robust to overallocating memory on large map outputs.
* | | | | | | | | | | | | | Pass sizes of map outputs back to MapOutputTrackerMatei Zaharia2012-10-069-83/+152
| | | | | | | | | | | | | |
* | | | | | | | | | | | | | Made block store return the size of each block put inMatei Zaharia2012-10-066-36/+70
| | | | | | | | | | | | | |
* | | | | | | | | | | | | | Warn about user programs that try to set spark.cache.classMatei Zaharia2012-10-061-1/+7
| | | | | | | | | | | | | |
* | | | | | | | | | | | | | Only group elements ten at a time into SequenceFile records inMatei Zaharia2012-10-061-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | saveAsObjectFile
* | | | | | | | | | | | | | Minor formatting fixesMatei Zaharia2012-10-053-3/+2
| | | | | | | | | | | | | |
* | | | | | | | | | | | | | Merge branch 'dev' of github.com:mesos/spark into devMatei Zaharia2012-10-0525-99/+228
|\ \ \ \ \ \ \ \ \ \ \ \ \ \
| * \ \ \ \ \ \ \ \ \ \ \ \ \ Merge pull request #249 from andyk/move-rdds-to-their-own-packageMatei Zaharia2012-10-0525-99/+228
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Move RDD classes/files to their own package/directory
| | * | | | | | | | | | | | | | Factor subclasses of RDD out of RDD.scala into their own classesAndy Konwinski2012-10-058-66/+106
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | in the rdd package.
| | * | | | | | | | | | | | | | Moves all files in core/src/main/scala/ that have RDD in their nameAndy Konwinski2012-10-0513-0/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | from that directory to a new core/src/main/scala/rdd directory.
| | * | | | | | | | | | | | | | Moves all files in core/src/main/scala/ that have RDD in them fromAndy Konwinski2012-10-0518-33/+122
| |/ / / / / / / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | package spark to package spark.rdd and updates all references to them.
* / / / / / / / / / / / / / / Cleaning up code slightlyMatei Zaharia2012-10-052-3/+3
|/ / / / / / / / / / / / / /
* | | | | | | | | | | | | | Reduce some overly aggressive logging in connection managerroot2012-10-062-9/+7
| | | | | | | | | | | | | |
* | | | | | | | | | | | | | Links quick start from nav barMatei Zaharia2012-10-051-0/+1
| | | | | | | | | | | | | |
* | | | | | | | | | | | | | Fix SizeEstimator tests to work with String classes in JDK 6 and 7Shivaram Venkataraman2012-10-052-12/+29
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/test/scala/spark/BoundedMemoryCacheSuite.scala
* | | | | | | | | | | | | | Merge pull request #247 from squito/devMatei Zaharia2012-10-052-1/+26
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Dev
| * | | | | | | | | | | | | | change tests to show utility of localValueImran Rashid2012-10-042-4/+5
| | | | | | | | | | | | | | |
| * | | | | | | | | | | | | | make accumulator.localValue public, add testsImran Rashid2012-10-042-1/+25
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/test/scala/spark/AccumulatorSuite.scala
* | | | | | | | | | | | | | | Scaladoc documentation for some core Spark functionalityMatei Zaharia2012-10-044-70/+180
| | | | | | | | | | | | | | |
* | | | | | | | | | | | | | | Merge branch 'dev' of github.com:mesos/spark into devMatei Zaharia2012-10-041-7/+12
|\| | | | | | | | | | | | | |
| * | | | | | | | | | | | | | Merge pull request #245 from pwendell/mem_tuningMatei Zaharia2012-10-031-7/+12
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Some additions to the Tuning Guide.
| | * | | | | | | | | | | | | | Some additions to the Tuning Guide.Patrick Wendell2012-10-031-7/+12
| |/ / / / / / / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 1. Slight change in organization 2. Added pre-requisites 3. Made a new section about determining memory footprint of an RDD 4. Other small changes
* / / / / / / / / / / / / / / Don't check for JARs in core/lib anymoreMatei Zaharia2012-10-042-5/+1
|/ / / / / / / / / / / / / /
* | | | | | | | | | | | | | Merge pull request #243 from andyk/mesos-from-maven-centralMatei Zaharia2012-10-032-1/+2
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Removes the included mesos-0.9.0.jar and pulls it from Maven Central instead
| * | | | | | | | | | | | | | Removes the included mesos-0.9.0.jar and adds a libraryDependency toAndy Konwinski2012-10-032-1/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | the build file so that mesos-0.9.0-incubating.jar (which contains the same class files, but has a silightly different name) will be pulled down from Maven Central instead.
* | | | | | | | | | | | | | | Merge pull request #244 from rxin/devReynold Xin2012-10-032-4/+4
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | |/ / / / / / / / / / / / / / |/| | | | | | | | | | | | | | Made Serializer and JavaSerializer non private.
| * | | | | | | | | | | | | | Made Serializer and JavaSerializer non private.Reynold Xin2012-10-032-4/+4
|/ / / / / / / / / / / / / /
* | | | | | | | | | | | | | Merge pull request #236 from pwendell/quickstartMatei Zaharia2012-10-032-0/+243
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | A Spark "Quick Start" example
| * | | | | | | | | | | | | | Responding to Matei's commentsPatrick Wendell2012-10-022-101/+57
| | | | | | | | | | | | | | |
| * | | | | | | | | | | | | | A Spark "Quick Start" examplePatrick Wendell2012-10-013-0/+287
| | |_|_|_|_|_|_|_|_|_|_|/ / | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit includes a quick start example that covers: 1) Basic usage of the Spark shell 2) A simple Spark job in Scala 3) A simple Spark job in Java
* | | | | | | | | | | | | | Made StorageLevel publicMatei Zaharia2012-10-031-2/+2
| | | | | | | | | | | | | |
* | | | | | | | | | | | | | Make more stuff private[spark]Matei Zaharia2012-10-026-4/+11
| |_|_|_|_|_|_|_|_|_|_|_|/ |/| | | | | | | | | | | |
* | | | | | | | | | | | | Simplify README even furtherMatei Zaharia2012-10-021-4/+2
| | | | | | | | | | | | |
* | | | | | | | | | | | | Merge pull request #242 from pwendell/readme-updateMatei Zaharia2012-10-021-1/+1
|\ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | Changing version of Scala in README
| * | | | | | | | | | | | | Changing version of Scala in READMEPatrick Wendell2012-10-021-1/+1
| | | | | | | | | | | | | |
* | | | | | | | | | | | | | Merge pull request #241 from shivaram/tuning-docMatei Zaharia2012-10-021-5/+63
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | First cut at adding documentation for GC tuning
| * | | | | | | | | | | | | | First cut at adding documentation for GC tuningShivaram Venkataraman2012-10-021-5/+63
| | | | | | | | | | | | | | |
* | | | | | | | | | | | | | | Merge pull request #240 from dennybritz/private_classesMatei Zaharia2012-10-02117-186/+243
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | |/ / / / / / / / / / / / / / |/| | | | | | | | | | | | | | Package-Private Classes
| * | | | | | | | | | | | | | Make Java API abstract wrapped functions privateDenny2012-10-022-2/+2
| | | | | | | | | | | | | | |
| * | | | | | | | | | | | | | accidentially removed traitDenny2012-10-021-1/+1
| | | | | | | | | | | | | | |
| * | | | | | | | | | | | | | Stylistic changes and Public Accumulable and BroadcastDenny2012-10-0230-59/+117
| | | | | | | | | | | | | | |
| * | | | | | | | | | | | | | Make dependency classes public - used by sparkDenny2012-10-021-5/+5
| | | | | | | | | | | | | | |