aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Merge pull request #227 from JoshRosen/fix/distinct_numsplitsMatei Zaharia2012-09-285-1/+12
|\ | | | | Allow controlling number of splits in distinct().
| * Use null as dummy value in distinct().Josh Rosen2012-09-281-1/+1
| |
| * Allow controlling number of splits in distinct().Josh Rosen2012-09-285-1/+12
| |
* | Don't create a Cache in SparkEnv because we don't use itMatei Zaharia2012-09-281-5/+1
| |
* | Logging tweaksMatei Zaharia2012-09-285-17/+23
| |
* | Renamed subdirs optionMatei Zaharia2012-09-281-1/+1
| |
* | Made subdirs per local dir configurable, and reduced lock usage a bitMatei Zaharia2012-09-281-12/+15
| |
* | Made disk store use multiple directories, deleted ShuffleManagerMatei Zaharia2012-09-286-417/+345
| |
* | Print and track user call sites in more places in SparkMatei Zaharia2012-09-286-54/+63
|/
* Merge pull request #225 from pwendell/devMatei Zaharia2012-09-282-1/+39
|\ | | | | Log message which records RDD origin
| * Fixing some whitespace issuesPatrick Wendell2012-09-281-9/+9
| |
| * Changes based on Matei's commentsPatrick Wendell2012-09-281-14/+14
| |
| * Log message which records RDD originPatrick Wendell2012-09-282-1/+39
| | | | | | | | | | | | | | | | | | | | | | | | | | This adds tracking to determine the "origin" of an RDD. Origin is defined by the boundary between the user's code and the spark code, during an RDD's instantiation. It is meant to help users understand where a Spark RDD is coming from in their code. This patch also logs origin data when stages are submitted to the scheduler. Finally, it adds a new log message to fix an inconsitency in the way that dependent stages (those missing parents) and independent stages (those without) are logged during submission.
* | Changed the way tasks' dependency files are sent to workers so thatMatei Zaharia2012-09-2814-156/+206
| | | | | | | | custom serializers or Kryo registrators can be loaded.
* | Fixed a bug where isLocal was set to false when using local[K]Matei Zaharia2012-09-281-1/+1
| |
* | Fix a bug in JAR fetcher that made it always fetch the JARMatei Zaharia2012-09-273-13/+9
| |
* | Added an option to compress blocks in the block storeMatei Zaharia2012-09-275-8/+56
| |
* | Renamed storage levels to something cleaner; fixes #223.Matei Zaharia2012-09-2710-59/+59
|/
* Merge branch 'dev' of github.com:mesos/spark into devMatei Zaharia2012-09-262-0/+23
|\
| * Merge pull request #222 from rxin/devMatei Zaharia2012-09-262-0/+23
| |\ | | | | | | Added MapPartitionsWithSplitRDD.
| | * Added MapPartitionsWithSplitRDD.Reynold Xin2012-09-262-0/+23
| | |
* | | Minor typosMatei Zaharia2012-09-262-3/+3
| | |
* | | Minor doc fixesMatei Zaharia2012-09-262-2/+5
|/ /
* | Updates to standalone cluster, web UI and deploy docs.Matei Zaharia2012-09-2625-109/+227
| |
* | Allow controlling number of splits in sortByKey.Matei Zaharia2012-09-264-12/+50
| |
* | More updates to docs, including tuning guideMatei Zaharia2012-09-267-43/+388
| |
* | Look for Kryo registrator using context class loaderMatei Zaharia2012-09-261-1/+2
|/
* Doc tweaksMatei Zaharia2012-09-261-2/+2
|
* Fixed a test that was getting extremely lucky before, and increased theMatei Zaharia2012-09-263-12/+16
| | | | number of samples used for sorting
* Doc fixesMatei Zaharia2012-09-253-15/+19
|
* Fixes to Java guideMatei Zaharia2012-09-253-38/+63
|
* Various enhancements to the programming guide and HTML/CSSMatei Zaharia2012-09-258-46/+207
|
* Several fixes to sampling issues pointed out by Henry Milner:Matei Zaharia2012-09-253-28/+35
| | | | | | | - takeSample was biased towards earlier partitions - There were some range errors in takeSample - SampledRDDs with replacement didn't produce appropriate counts across partitions (we took exactly frac of each one)
* More updates to documentationMatei Zaharia2012-09-2517-48/+69
|
* Merge branch 'dev' of github.com:mesos/spark into devMatei Zaharia2012-09-251-0/+13
|\
| * Merge pull request #220 from andyk/docMatei Zaharia2012-09-251-0/+13
| |\ | | | | | | One commit that makes nav dropdowns show on hover
| | * Makes nav menu dropdowns show on hover instead of on click.Andy Konwinski2012-09-251-0/+13
| | |
| | * Merge remote-tracking branch 'public-spark/dev' into docAndy Konwinski2012-09-2528-132/+478
| | |\ | | |/ | |/|
| | * Merge remote-tracking branch 'public-spark/dev' into docAndy Konwinski2012-09-161-1/+1
| | |\
* | | | Documentation updatesMatei Zaharia2012-09-254-91/+103
| | | |
* | | | Update license info on deploy scriptsMatei Zaharia2012-09-253-26/+17
| | | |
* | | | Update Jekyll plugin to look at Scala 2.9.2 docsMatei Zaharia2012-09-251-1/+1
|/ / /
* | | Merge pull request #219 from rnpandya/devMatei Zaharia2012-09-252-1/+5
|\ \ \ | | | | | | | | Add spark-shell.cmd
| * | | Add spark-shell.cmdRavi Pandya2012-09-252-1/+5
| | | |
* | | | Merge pull request #217 from rxin/devMatei Zaharia2012-09-241-0/+2
|\ \ \ \ | | | | | | | | | | Added a method to RDD to expose the ClassManifest.
| * | | | Renamed RDD.manifest to RDD.elementClassManifestReynold Xin2012-09-241-1/+1
| | | | |
| * | | | Added a method to RDD to expose the ClassManifest.Reynold Xin2012-09-241-0/+2
| | | | |
* | | | | Merge pull request #218 from rnpandya/devMatei Zaharia2012-09-244-1/+77
|\ \ \ \ \ | | |/ / / | |/| | | Scripts to start Spark under windows
| * | | | Echo offRavi Pandya2012-09-241-1/+1
| | | | |
| * | | | Windows command scripts for sbt and runRavi Pandya2012-09-244-1/+77
| |/ / /
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-13 13:03:12 +0000