aboutsummaryrefslogtreecommitdiff
Commit message (Expand)AuthorAgeFilesLines
* Simplified and documented code a little and added testMatei Zaharia2011-07-143-31/+70
* Merge branch 'master' into implicit-sequencefileMatei Zaharia2011-07-1318-397/+714
|\
| * Updated save code to allow non-file-based OutputFormats and added a testMatei Zaharia2011-07-136-91/+160
| * Increase default value of spark.locality.wait a littleMatei Zaharia2011-07-131-1/+1
| * Added mapPartitions operation and a bunch of tests for RDD opsMatei Zaharia2011-07-132-10/+49
| * Simplified parallel shuffle fetcher to use URLConnectionMatei Zaharia2011-07-112-45/+24
| * Moved PairRDD and SequenceFileRDD functions to separate source filesMatei Zaharia2011-07-104-292/+371
| * bug fixMatei Zaharia2011-07-091-32/+34
| * Register byte[] with Kryo serializerMatei Zaharia2011-07-091-1/+1
| * Added parallel shuffle fetcherMatei Zaharia2011-07-099-22/+163
| * Support for non-filesystem-based Hadoop data sourcesMatei Zaharia2011-07-062-24/+32
* | Initial work to make stuff like sequenceFile[Int, Int] work withoutMatei Zaharia2011-06-281-7/+37
|/
* Don't pass a null context when running tasks locallyMatei Zaharia2011-06-271-1/+2
* Fix a compile errorMatei Zaharia2011-06-271-1/+1
* Merge pull request #64 from mesos/td-rdd-savetdas2011-06-2710-16/+398
|\
| * Merge branch 'master' into td-rdd-saveTathagata Das2011-06-2725-2331/+3606
| |\ | |/ |/|
* | Print version number 0.3 in REPLMatei Zaharia2011-06-261-1/+1
* | Merge branch 'mos-bt'Matei Zaharia2011-06-2620-2281/+3446
|\ \
| * | Issue #42 fixed.Mosharaf Chowdhury2011-04-287-13/+19
| * | Refactoring: daemonThreadFactories have all been moved to the UtilsMosharaf Chowdhury2011-04-279-86/+54
| * | Cleanup + refactoring...Mosharaf Chowdhury2011-04-276-112/+41
| * | Shuffle is also working from its own subpackage.Mosharaf Chowdhury2011-04-2713-47/+30
| * | Removed some shuffle implementations. Remaining ones all use local filesMosharaf Chowdhury2011-04-279-5723/+0
| * | Merge branch 'mos-shuffle-tracked' into mos-btMosharaf Chowdhury2011-04-2721-12/+7608
| |\ \
| | * \ Merge branch 'master' into mos-shuffle-trackedMosharaf Chowdhury2011-04-27304-4645/+103106
| | |\ \
| | * | | Added the fake shuffle to git.Mosharaf Chowdhury2011-02-051-0/+495
| | * | | Bug fix: a reducer never returns until its shuffleConsumer thread joins.Mosharaf Chowdhury2011-01-2510-40/+60
| | * | | Updating hasSplits variable inside a synchronized block now. This was causing...Mosharaf Chowdhury2011-01-2210-10/+10
| | * | | Bug fix in a log statementMosharaf Chowdhury2011-01-201-1/+1
| | * | | Bug fixes + updated limit connecitons shuffle strategy to handle endgame situ...Mosharaf Chowdhury2011-01-145-11/+27
| | * | | Revamped tracker interface. Now tracker can send back multiple response at th...Mosharaf Chowdhury2011-01-146-141/+153
| | * | | Implemented a tracker strategy that allows reducers to create concurrent conn...Mosharaf Chowdhury2011-01-134-12/+145
| | * | | Changed speed estimation and time remaining variables to Double instead of Int.Mosharaf Chowdhury2011-01-131-9/+8
| | * | | Added a tracker strategy that selects random mappers for reducers. This can b...Mosharaf Chowdhury2011-01-132-1/+43
| | * | | In-memory version of tracker+blocked shuffle checked in.Mosharaf Chowdhury2011-01-104-26/+933
| | * | | Updated conf/java-optsMosharaf Chowdhury2011-01-091-1/+14
| | * | | Merge branch 'mos-shuffle-tracked' of git@github.com:mesos/spark into mos-shu...Mosharaf Chowdhury2011-01-071-2/+3
| | |\ \ \
| | | * | | Updated simple skewed group-by to generate multiple keys with eachMatei Zaharia2011-01-051-2/+3
| | * | | | Updated BalanceRemaining strategy for a better faster-reducers identification...Mosharaf Chowdhury2011-01-051-1/+7
| | |/ / /
| | * | | trackerStrategy can now only be accessed by one thread at a time.Mosharaf Chowdhury2011-01-052-12/+26
| | * | | Bug fixes, optimizations, changes to ShuffleClient/Tracker interface and upda...Mosharaf Chowdhury2011-01-053-64/+180
| | * | | Added a skewed reduce test where one reducer gets more keys than theMatei Zaharia2011-01-041-0/+48
| | * | | Updated BalanceRemainingShuffleTrackerStrategy. Better divisioning of slower ...Mosharaf Chowdhury2011-01-031-27/+27
| | * | | Bug fix: splitsInRequestBitVector(splitIndex) was wrongly set to false after ...Mosharaf Chowdhury2011-01-033-30/+6
| | * | | - Updated Reducer-Tracker communication protocol.Mosharaf Chowdhury2011-01-025-55/+243
| | * | | TrackedCustomBlockedLocalFileShuffle has also been updated.Mosharaf Chowdhury2010-12-303-108/+133
| | * | | CustomBlockedInMemoryShuffle is receiving multiple blocks after connecting to...Mosharaf Chowdhury2010-12-302-85/+111
| | * | | Bug fix/update: All the shuffle implementations are using consistent config p...Mosharaf Chowdhury2010-12-309-256/+50
| | * | | Consumption is delayed until everything has been received. Otherwise it inte...Mosharaf Chowdhury2010-12-3010-64/+145
| | * | | CustomBlockedLocalFileShuffle: reducers are reading multiple blocks per conne...Mosharaf Chowdhury2010-12-305-110/+145
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-19 08:34:54 +0000