aboutsummaryrefslogtreecommitdiff
Commit message (Expand)AuthorAgeFilesLines
* Initial work to get Spark compiling with SBT 0.7.5 RC0Matei Zaharia2010-11-13203-38/+28
* Added some stuff to .gitignoreMatei Zaharia2010-11-131-0/+3
* Undo JLine fix that turns out to only be needed when buildr is runningMatei Zaharia2010-11-132-2/+3
* Modified project structure to work with buildrMatei Zaharia2010-11-1352-7/+47
* Added a shuffle test with negative hash codes for some keys (this was a bug e...Matei Zaharia2010-11-121-0/+11
* Unit tests for shuffle operations. Fixes #33.Matei Zaharia2010-11-121-0/+119
* Added options for using an external HTTP server with LocalFileShuffleMatei Zaharia2010-11-093-19/+41
* Removed unnecessary collectAsMapMatei Zaharia2010-11-081-4/+2
* Made shuffle algorithm pluggable and added LocalFileShuffle.Matei Zaharia2010-11-086-56/+237
* Create output files one by one instead of at the same time in the mapMatei Zaharia2010-11-061-12/+11
* Merge branch 'matei-shuffle' of github.com:mesos/spark into matei-shuffleMatei Zaharia2010-11-040-0/+0
|\
| * Fixed a small bug in DFS shuffle -- the number of reduce tasks was not being ...root2010-11-041-1/+2
* | Properly set the number of output splits in DFS shuffleMatei Zaharia2010-11-041-1/+2
|/
* Added groupBy function in RDDMatei Zaharia2010-11-031-1/+9
* Added reduceByKey, groupByKey and join operations based on combine, asMatei Zaharia2010-11-034-56/+115
* Fixed a bug with negative hashcodesMatei Zaharia2010-11-031-1/+4
* Made DFS shuffle's "reduce tasks" fetch inputs in a random order so theyMatei Zaharia2010-11-032-5/+21
* Initial work towards a simple HDFS-based shuffle.Matei Zaharia2010-11-033-1/+155
* Made alltests write test output as XML in build/test_resultsMatei Zaharia2010-11-021-1/+6
* 'Running on Mesos' test is now only run when MESOS_HOME is setMatei Zaharia2010-11-021-4/+2
* Added initial attempt at a BoundedMemoryCacheMatei Zaharia2010-10-241-0/+69
* Added SizeEstimator class for use by cachesMatei Zaharia2010-10-241-0/+160
* Made caching pluggable and added soft reference and weak reference caches.Matei Zaharia2010-10-237-12/+98
* Renamed aggregateSplit() to splitRdd(), plus some style fixesMatei Zaharia2010-10-231-7/+14
* Fixed a bug with scheduling of tasks that have no locality preferences.Matei Zaharia2010-10-191-9/+26
* Undid some changes that Mosharaf inadvertedly committed to master.Matei Zaharia2010-10-193-3/+2
* Merge branch 'master' of git@github.com:mesos/sparkMosharaf Chowdhury2010-10-1823-508/+922
|\
| * Less hacky way of preventing config files from being overwritten when a templ...Matei Zaharia2010-10-161-2/+2
| * Changed the config files that were included in git to templates whichMatei Zaharia2010-10-164-3/+10
| * Fixed some whitespaceMatei Zaharia2010-10-163-14/+14
| * Added support for generic Hadoop InputFormats and refactored textFile toMatei Zaharia2010-10-162-28/+111
| * Renamed HdfsFile to HadoopFileMatei Zaharia2010-10-162-8/+9
| * Simplified UnionRDD slightly and added a SparkContext.union method for effici...Matei Zaharia2010-10-162-28/+22
| * Removed setSparkHome method on SparkContext in favor of having anMatei Zaharia2010-10-162-16/+7
| * Added the ability to specify a list of JAR files when creating aMatei Zaharia2010-10-167-117/+247
| * Set absolute path for SPARK_HOMEMatei Zaharia2010-10-162-2/+2
| * Keep track of tasks in each job so that they can be removed when the job exitsMatei Zaharia2010-10-161-6/+12
| * Further clarified some codeMatei Zaharia2010-10-162-10/+22
| * Fixed some log messagesMatei Zaharia2010-10-161-2/+2
| * Bug fixes and improvements for MesosScheduler and SimpleJobMatei Zaharia2010-10-163-25/+46
| * Moved Spark home detection to SparkContext and added a setSparkHomeMatei Zaharia2010-10-162-51/+81
| * Bug fix in passing env vars to executorsMatei Zaharia2010-10-161-1/+1
| * Added code so that Spark jobs can be launched from outside the SparkMatei Zaharia2010-10-152-6/+39
| * Moved ClassServer out of repl packaged and renamed it to HttpServer.Matei Zaharia2010-10-152-12/+12
| * Increased default memory for alltestsMatei Zaharia2010-10-151-0/+3
| * Abort jobs if a task fails more than a limited number of timesMatei Zaharia2010-10-153-23/+44
| * Updated guava to version r07Matei Zaharia2010-10-156-2/+2
| * A couple of improvements to ReplSuite:Matei Zaharia2010-10-151-26/+30
| * Made locality scheduling constant-time and added support for changingMatei Zaharia2010-10-151-24/+79
| * Moved Job and SimpleJob to new filesMatei Zaharia2010-10-073-183/+206
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-20 02:50:11 +0000