aboutsummaryrefslogtreecommitdiff
path: root/core
Commit message (Expand)AuthorAgeFilesLines
* Made checkpoint data in RDDs optional to further reduce serialized size.Tathagata Das2012-12-113-14/+28
* Fixed bug in UnionRDD and CoGroupedRDDTathagata Das2012-12-113-115/+10
* Bunch of bug fixes related to checkpointing in RDDs. RDDCheckpointData object...Tathagata Das2012-12-1013-90/+389
* Modified checkpoint testsuite to more comprehensively test checkpointing of v...Tathagata Das2012-12-0714-110/+285
* Refactored RDD checkpointing to minimize extra fields in RDD class.Tathagata Das2012-12-0411-191/+140
* Added metadata cleaner to HttpBroadcast to clean up old broacast files.Tathagata Das2012-12-031-0/+24
* Made RDD checkpoint not create a new thread. Fixed bug in detecting when spar...Tathagata Das2012-12-022-22/+12
* Minor modifications.Tathagata Das2012-12-011-1/+6
* Added TimeStampedHashSet and used that to cleanup the list of registered RDD ...Tathagata Das2012-11-293-9/+81
* Added metadata cleaner to BlockManager to remove old blocks completely.Tathagata Das2012-11-282-12/+36
* Renamed CleanupTask to MetadataCleaner.Tathagata Das2012-11-285-14/+15
* Modified StorageLevel and BlockManagerId to cache common objects and use cach...Tathagata Das2012-11-284-29/+101
* Bug fixesTathagata Das2012-11-282-9/+19
* Modified bunch HashMaps in Spark to use TimeStampedHashMap and made various m...Tathagata Das2012-11-276-14/+156
* Merged branch mesos/master to branch dev.Tathagata Das2012-11-2627-76/+313
|\
| * Merge pull request #304 from mbautin/configurable_local_ipMatei Zaharia2012-11-191-1/+7
| |\
| | * Addressing Matei's comment: SPARK_LOCAL_IP environment variablembautin2012-11-191-1/+1
| | * SPARK-624: make the default local IP customizablembautin2012-11-151-1/+7
| * | Set default uncaught exception handler to exit.Charles Reiss2012-11-162-1/+15
| |/
| * Use DNS names instead of IP addresses in standalone mode, to allowMatei Zaharia2012-11-152-4/+4
| * Detect correctly when one has disconnected from a standalone cluster.Matei Zaharia2012-11-111-1/+13
| * Fix K-means example a littleroot2012-11-101-1/+2
| * Incorporated Matei's suggestions. Tested with 5 producer(consumer) threads ea...Tathagata Das2012-11-092-4/+18
| * Fixed deadlock in BlockManager.Tathagata Das2012-11-093-87/+180
| * Added an option to spread out jobs in the standalone mode.Matei Zaharia2012-11-083-18/+56
| * Fix for connections not being reused (from Josh Rosen)Matei Zaharia2012-11-081-1/+2
| * fix bug in getting slave id out of mesosImran Rashid2012-11-081-1/+1
| * Various fixes to standalone mode and web UI:Matei Zaharia2012-11-0713-45/+110
| * Made Akka timeout and message frame size configurable, and upped the defaultsMatei Zaharia2012-11-061-2/+5
| * Remove unnecessary hash-map put in MemoryStoreShivaram Venkataraman2012-11-011-3/+0
| * Don't throw an error in the block manager when a block is cached on the maste...root2012-10-261-0/+6
* | Fixed bug in the number of splits in RDD after checkpointing. Modified reduce...Tathagata Das2012-11-191-1/+2
* | Fixed checkpointing bug in CoGroupedRDD. CoGroupSplits kept around the RDD sp...Tathagata Das2012-11-172-4/+42
* | Optimized checkpoint writing by reusing FileSystem object. Fixed bug in updat...Tathagata Das2012-11-131-5/+1
* | Refactored BlockManagerMaster (not BlockManagerMasterActor) to simplify the c...Tathagata Das2012-11-113-198/+127
* | Fixed deadlock in BlockManager.Tathagata Das2012-11-092-89/+101
* | Fixed major bugs in checkpointing.Tathagata Das2012-11-051-2/+4
* | Made checkpointing of dstream graph to work with checkpointing of RDDs. For s...Tathagata Das2012-11-042-15/+30
* | Added 'synchronized' to RDD serialization to ensure checkpoint-related change...Tathagata Das2012-10-313-4/+92
* | Added checkpointing support to all RDDs, along with CheckpointSuite to test c...Tathagata Das2012-10-3022-107/+352
* | Modified RDD API to make dependencies a var (therefore can be changed to chec...Tathagata Das2012-10-2919-107/+149
* | Merge remote-tracking branch 'public/master' into devMatei Zaharia2012-10-24194-2097/+5043
|\|
| * Strip leading mesos:// in URLs passed to MesosMatei Zaharia2012-10-241-2/+3
| * Merge pull request #281 from rxin/memreportMatei Zaharia2012-10-233-71/+93
| |\
| | * Serialize accumulator updates in TaskResult for local mode.Reynold Xin2012-10-151-4/+5
| | * Added a method to report slave memory status.Reynold Xin2012-10-142-67/+88
| * | Merge remote-tracking branch 'JoshRosen/shuffle_refactoring' into devMatei Zaharia2012-10-2313-250/+113
| |\ \
| | * | Remove map-side combining from ShuffleMapTask.Josh Rosen2012-10-138-94/+37
| | * | Remove mapSideCombine field from Aggregator.Josh Rosen2012-10-135-22/+15
| | * | Change ShuffleFetcher to return an Iterator.Josh Rosen2012-10-138-167/+63