aboutsummaryrefslogtreecommitdiff
path: root/src
Commit message (Expand)AuthorAgeFilesLines
* Fixed some more stuff (Eclispe target and native build)Matei Zaharia2010-11-132-5/+8
* Undo JLine fix that turns out to only be needed when buildr is runningMatei Zaharia2010-11-131-2/+2
* Modified project structure to work with buildrMatei Zaharia2010-11-1348-4/+20
* Added a shuffle test with negative hash codes for some keys (this was a bug e...Matei Zaharia2010-11-121-0/+11
* Unit tests for shuffle operations. Fixes #33.Matei Zaharia2010-11-121-0/+119
* Added options for using an external HTTP server with LocalFileShuffleMatei Zaharia2010-11-093-19/+41
* Removed unnecessary collectAsMapMatei Zaharia2010-11-081-4/+2
* Made shuffle algorithm pluggable and added LocalFileShuffle.Matei Zaharia2010-11-086-56/+237
* Create output files one by one instead of at the same time in the mapMatei Zaharia2010-11-061-12/+11
* Properly set the number of output splits in DFS shuffleMatei Zaharia2010-11-041-1/+2
* Added groupBy function in RDDMatei Zaharia2010-11-031-1/+9
* Added reduceByKey, groupByKey and join operations based on combine, asMatei Zaharia2010-11-034-56/+115
* Fixed a bug with negative hashcodesMatei Zaharia2010-11-031-1/+4
* Made DFS shuffle's "reduce tasks" fetch inputs in a random order so theyMatei Zaharia2010-11-032-5/+21
* Initial work towards a simple HDFS-based shuffle.Matei Zaharia2010-11-033-1/+155
* 'Running on Mesos' test is now only run when MESOS_HOME is setMatei Zaharia2010-11-021-4/+2
* Added initial attempt at a BoundedMemoryCacheMatei Zaharia2010-10-241-0/+69
* Added SizeEstimator class for use by cachesMatei Zaharia2010-10-241-0/+160
* Made caching pluggable and added soft reference and weak reference caches.Matei Zaharia2010-10-237-12/+98
* Renamed aggregateSplit() to splitRdd(), plus some style fixesMatei Zaharia2010-10-231-7/+14
* Fixed a bug with scheduling of tasks that have no locality preferences.Matei Zaharia2010-10-191-9/+26
* Undid some changes that Mosharaf inadvertedly committed to master.Matei Zaharia2010-10-191-1/+1
* Merge branch 'master' of git@github.com:mesos/sparkMosharaf Chowdhury2010-10-1813-498/+894
|\
| * Fixed some whitespaceMatei Zaharia2010-10-163-14/+14
| * Added support for generic Hadoop InputFormats and refactored textFile toMatei Zaharia2010-10-162-28/+111
| * Renamed HdfsFile to HadoopFileMatei Zaharia2010-10-162-8/+9
| * Simplified UnionRDD slightly and added a SparkContext.union method for effici...Matei Zaharia2010-10-162-28/+22
| * Removed setSparkHome method on SparkContext in favor of having anMatei Zaharia2010-10-162-16/+7
| * Added the ability to specify a list of JAR files when creating aMatei Zaharia2010-10-166-116/+244
| * Keep track of tasks in each job so that they can be removed when the job exitsMatei Zaharia2010-10-161-6/+12
| * Further clarified some codeMatei Zaharia2010-10-162-10/+22
| * Fixed some log messagesMatei Zaharia2010-10-161-2/+2
| * Bug fixes and improvements for MesosScheduler and SimpleJobMatei Zaharia2010-10-163-25/+46
| * Moved Spark home detection to SparkContext and added a setSparkHomeMatei Zaharia2010-10-162-51/+81
| * Bug fix in passing env vars to executorsMatei Zaharia2010-10-161-1/+1
| * Added code so that Spark jobs can be launched from outside the SparkMatei Zaharia2010-10-151-2/+29
| * Moved ClassServer out of repl packaged and renamed it to HttpServer.Matei Zaharia2010-10-152-12/+12
| * Abort jobs if a task fails more than a limited number of timesMatei Zaharia2010-10-153-23/+44
| * A couple of improvements to ReplSuite:Matei Zaharia2010-10-151-26/+30
| * Made locality scheduling constant-time and added support for changingMatei Zaharia2010-10-151-24/+79
| * Moved Job and SimpleJob to new filesMatei Zaharia2010-10-073-183/+206
| * Merge branch 'master' into matei-schedulingMatei Zaharia2010-10-074-11/+23
| |\
| * \ Merge branch 'master' into matei-schedulingMatei Zaharia2010-10-074-10/+21
| |\ \
| * \ \ Merge branch 'master' into matei-schedulingMatei Zaharia2010-10-053-3/+64
| |\ \ \
| * \ \ \ Merge branch 'master' into matei-schedulingMatei Zaharia2010-10-032-0/+2
| |\ \ \ \
| * | | | | Renamed ParallelOperation to JobMatei Zaharia2010-10-031-42/+42
* | | | | | Minor cleanup in Broadcast.scala.Mosharaf Chowdhury2010-10-124-82/+88
| |_|_|_|/ |/| | | |
* | | | | Added a getId method to split to force classes to specify a unique IDMatei Zaharia2010-10-074-11/+23
| |_|_|/ |/| | |
* | | | got rid of unnecessary lineJustin Ma2010-10-071-1/+0
* | | | Merge branch 'master' into jtma-accumulatorJustin Ma2010-10-0713-124/+372
|\ \ \ \