aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Added stop() to the Broadcast subsystemMosharaf Chowdhury2012-07-106-23/+27
|
* Slightly better check for isLocalMosharaf Chowdhury2012-07-101-1/+1
|
* RefactoringMosharaf Chowdhury2012-07-093-127/+76
|
* RefactoringMosharaf Chowdhury2012-07-092-10/+10
|
* RefactoringMosharaf Chowdhury2012-07-095-353/+390
|
* Refactored TrackMultipleValues out.Mosharaf Chowdhury2012-07-093-328/+210
|
* TweaksMosharaf Chowdhury2012-07-094-24/+19
|
* Removed some unused stuffMosharaf Chowdhury2012-07-084-63/+13
|
* Compiles without DfsMosharaf Chowdhury2012-07-082-45/+6
|
* Removed Chained and Dfs broadcast implementationsMosharaf Chowdhury2012-07-082-929/+0
|
* Further updates to run processes on cluster.Matei Zaharia2012-07-0111-33/+298
|
* More work on standalone deploy system.Matei Zaharia2012-07-0114-85/+465
|
* Detect connection and disconnection of slavesMatei Zaharia2012-06-305-47/+123
|
* More work on deploy code (adding Worker class)Matei Zaharia2012-06-3018-127/+351
|
* Initial framework to get a master and web UI up.Matei Zaharia2012-06-3011-29/+222
|
* Various code style fixes, mostly from IntelliJ IDEAMatei Zaharia2012-06-2941-287/+328
|
* Scalacheck groupId has changed ↵rrmckinley2012-06-291-1/+1
| | | | https://github.com/rickynils/scalacheck/issues/24. Necessary to build with scalaVersion 2.9.2. Works with 2.9.1 too.
* Increase the default wait time for EC2 clusters to 2 minutes.Matei Zaharia2012-06-291-2/+2
|
* Fixes to CoarseMesosSchedulerMatei Zaharia2012-06-291-8/+12
|
* Allow binding to a free port and change Akka logging to use SLF4J. AlsoMatei Zaharia2012-06-296-19/+38
| | | | fixes various bugs in the previous code when running on Mesos.
* Ignore some IDE filesMatei Zaharia2012-06-281-0/+2
|
* Upgraded to Akka 2 and fixed test execution (which was still parallelMatei Zaharia2012-06-2811-271/+364
| | | | across projects).
* Fixed issues duplicate class issues in sbt assembly.Tathagata Das2012-06-221-2/+10
|
* Various fixes when running on Mesosroot2012-06-203-5/+9
|
* Added testcase for ByteBufferInputStream bugs.Tathagata Das2012-06-171-2/+17
|
* Update SBT and SBT-Eclipse versionMatei Zaharia2012-06-172-8/+5
|
* Fixed nasty corner case bug in ByteBufferInputStream. Could not add a test ↵Tathagata Das2012-06-171-4/+8
| | | | case for this as I could not figure out how to deterministically reproduce the bug in a short testcase.
* Various fixes to get unit tests running. In particular, shut downMatei Zaharia2012-06-175-24/+42
| | | | | | ConnectionManager and DAGScheduler properly, plus a fix to LocalScheduler that was not merged in from 0.5 and was actually caught by one of the tests.
* Update version number for dev branchMatei Zaharia2012-06-152-2/+2
|
* Fixed HttpBroadcast to work with this branch's Serializer.Matei Zaharia2012-06-151-2/+2
|
* Merge branch 'master' into devMatei Zaharia2012-06-1518-102/+926
|\
| * Changed version in master branch to 0.5.1-SNAPSHOT for furtherMatei Zaharia2012-06-132-2/+2
| | | | | | | | development.
| * Update version in SBTv0.5.0Matei Zaharia2012-06-121-1/+1
| |
| * Updated version number to 0.5.0Matei Zaharia2012-06-121-1/+1
| |
| * Added script for launching Spark on EC2 from Mesos, to make it easierMatei Zaharia2012-06-105-0/+571
| | | | | | | | for new users to get up and running on EC2.
| * Merge branch 'master' into mesos-0.9Matei Zaharia2012-06-091-3/+3
| |\
| | * Further bug fix to HttpBroadcastMatei Zaharia2012-06-091-3/+3
| | |
| * | Merge branch 'master' into mesos-0.9Matei Zaharia2012-06-091-0/+1
| |\|
| | * Bug fix to HttpBroadcastMatei Zaharia2012-06-091-0/+1
| | |
| * | Merge branch 'master' into mesos-0.9Matei Zaharia2012-06-0911-100/+352
| |\|
| | * Change the default broadcast implementation to a simple HTTP-basedMatei Zaharia2012-06-095-5/+144
| | | | | | | | | | | | broadcast. Fixes #139.
| | * Performance improvements to shuffle operations: in particular, preserveMatei Zaharia2012-06-096-95/+208
| | | | | | | | | | | | | | | RDD partitioning in more cases where it's possible, and use iterators instead of materializing collections when doing joins.
* | | Merge branch 'dev' of github.com:mesos/spark into devMatei Zaharia2012-06-1512-138/+278
|\ \ \
| * | | Added shutdown for akka to SparkContext.stop(). Helps a little, but many ↵Tathagata Das2012-06-136-9/+16
| | | | | | | | | | | | | | | | testsuites still fail.
| * | | Multiple bug fixes to pass the testsuites ShuffleSuite and BlockManagerSuite.Tathagata Das2012-06-1311-131/+264
| | | |
* | | | Update SBT to version 0.11.3-2.Matei Zaharia2012-06-072-0/+0
|/ / /
* | | Added BlockManagerSuite, which I'd forgotten to merge.Matei Zaharia2012-06-071-0/+182
| | |
* | | Merge in engine improvements from the Spark Streaming project, developedMatei Zaharia2012-06-0786-1409/+6374
|/ / | | | | | | | | | | jointly with Tathagata Das and Haoyuan Li. This commit imports the changes and ports them to Mesos 0.9, but does not yet pass unit tests due to various classes not supporting a graceful stop() yet.
* | Merge branch 'master' into mesos-0.9Matei Zaharia2012-06-062-14/+11
|\|
| * Commit task outputs to Hadoop-supported storage systems in parallel on theMatei Zaharia2012-06-062-14/+11
| | | | | | | | cluster instead of on the master. Fixes #110.