aboutsummaryrefslogtreecommitdiff
path: root/core
Commit message (Expand)AuthorAgeFilesLines
* Lowered default number of splits for filesMatei Zaharia2011-07-141-1/+1
* Set class loader for remote actors to fix a bug that happens in 2.9Matei Zaharia2011-07-142-0/+9
* Renamed ParallelArray to ParallelCollectionMatei Zaharia2011-07-143-30/+27
* Remove RDD.toString because it looked confusingMatei Zaharia2011-07-141-4/+0
* Fix tracking of updates in accumulators to solve an issue that would manifest...Matei Zaharia2011-07-142-13/+21
* Forgot to add a fileMatei Zaharia2011-07-141-0/+170
* Cleaned up a few issues to do with default parallelism levels. AlsoMatei Zaharia2011-07-1410-275/+114
* Simplified and documented code a little and added testMatei Zaharia2011-07-143-31/+70
* Merge branch 'master' into implicit-sequencefileMatei Zaharia2011-07-1317-395/+714
|\
| * Updated save code to allow non-file-based OutputFormats and added a testMatei Zaharia2011-07-136-91/+160
| * Increase default value of spark.locality.wait a littleMatei Zaharia2011-07-131-1/+1
| * Added mapPartitions operation and a bunch of tests for RDD opsMatei Zaharia2011-07-132-10/+49
| * Simplified parallel shuffle fetcher to use URLConnectionMatei Zaharia2011-07-111-44/+24
| * Moved PairRDD and SequenceFileRDD functions to separate source filesMatei Zaharia2011-07-104-292/+371
| * bug fixMatei Zaharia2011-07-091-32/+34
| * Register byte[] with Kryo serializerMatei Zaharia2011-07-091-1/+1
| * Added parallel shuffle fetcherMatei Zaharia2011-07-098-20/+162
| * Support for non-filesystem-based Hadoop data sourcesMatei Zaharia2011-07-062-24/+32
* | Initial work to make stuff like sequenceFile[Int, Int] work withoutMatei Zaharia2011-06-281-7/+37
|/
* Don't pass a null context when running tasks locallyMatei Zaharia2011-06-271-1/+2
* Fix a compile errorMatei Zaharia2011-06-271-1/+1
* Merge branch 'master' into td-rdd-saveTathagata Das2011-06-2717-2275/+3381
|\
| * Merge branch 'mos-bt'Matei Zaharia2011-06-2615-2274/+3285
| |\
| | * Issue #42 fixed.Mosharaf Chowdhury2011-04-287-13/+19
| | * Refactoring: daemonThreadFactories have all been moved to the UtilsMosharaf Chowdhury2011-04-279-86/+54
| | * Cleanup + refactoring...Mosharaf Chowdhury2011-04-276-112/+41
| | * Shuffle is also working from its own subpackage.Mosharaf Chowdhury2011-04-2710-12/+30
| | * Removed some shuffle implementations. Remaining ones all use local filesMosharaf Chowdhury2011-04-279-5723/+0
| | * Merge branch 'mos-shuffle-tracked' into mos-btMosharaf Chowdhury2011-04-2715-12/+7444
| | |\
| | | * Merge branch 'master' into mos-shuffle-trackedMosharaf Chowdhury2011-04-2716-13/+7445
| | * | Added support for custom classes. (from 49ea48)Mosharaf Chowdhury2011-04-271-1/+4
| | * | Refacoring...Mosharaf Chowdhury2011-04-263-33/+53
| | * | Moved broadcast-related code to separate directory under spark.broadcastMosharaf Chowdhury2011-04-267-13/+26
| | * | Merge branch 'master' into mos-btMosharaf Chowdhury2011-04-26157-3306/+100472
| | |\|
| | * | Refactoring...Mosharaf Chowdhury2011-04-264-150/+60
| | * | Renamed MaxRxPeers to MaxTxPeers to MaxTxSlots and MaxRxSlotsMosharaf Chowdhury2011-04-132-27/+12
| | * | hasBlocks is now AtomicInteger (even though it was ok)Mosharaf Chowdhury2011-04-022-15/+14
| | * | BroadcastSuperTracker (right now for BT) is contacted over TCP insteadMosharaf Chowdhury2011-04-013-63/+167
| | * | Formatting...Mosharaf Chowdhury2011-04-012-2/+2
| | * | Formatting...Mosharaf Chowdhury2011-04-014-477/+477
| | * | Each broadcasted variable can have different blockSize. CorrespondingMosharaf Chowdhury2011-03-314-351/+360
| | * | Consolidated Broadcast config params.Mosharaf Chowdhury2011-03-304-178/+95
| | * | Removed gossip-related code that were already commented out.Mosharaf Chowdhury2011-03-301-104/+79
| | * | Formatting...Mosharaf Chowdhury2011-03-301-525/+525
| | * | Random is the default choice; rarestFirst didn't work well inMosharaf Chowdhury2011-03-291-1/+1
| | * | Picking peers weighted by the number of rare blocks they have. A block is rar...Mosharaf Chowdhury2011-02-151-10/+91
| | * | Optimization: Master sends out at least one copy of each block first regardle...Mosharaf Chowdhury2011-02-141-5/+18
| | * | pickBlockRarestFirst and gossips commented OUT for now.Mosharaf Chowdhury2011-02-131-17/+17
| | * | Fix in rarestFirst implemenation.Mosharaf Chowdhury2011-02-101-8/+19
| | * | Peers now gossip about their neighbors when they talk.Mosharaf Chowdhury2011-02-101-2/+21