| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | Merge pull request #370 from tdas/streaming | Tathagata Das | 2013-01-13 | 1 | -3/+3 |
| |\ | | | | | Added more documentation and minor change in API for NetworkReceiver | ||||
| | * | Added documentation for PairDStreamFunctions. | Tathagata Das | 2013-01-13 | 1 | -3/+3 |
| | | | |||||
| * | | switch to uppercase constants | Ryan LeCompte | 2013-01-13 | 1 | -4/+4 |
| | | | |||||
| * | | more code cleanup | Ryan LeCompte | 2013-01-13 | 1 | -31/+32 |
| | | | |||||
| * | | add comment | Ryan LeCompte | 2013-01-12 | 1 | -0/+1 |
| | | | |||||
| * | | add one extra test | Ryan LeCompte | 2013-01-12 | 1 | -0/+1 |
| | | | |||||
| * | | correct test params | Ryan LeCompte | 2013-01-12 | 1 | -2/+2 |
| | | | |||||
| * | | add unit test | Ryan LeCompte | 2013-01-11 | 2 | -1/+23 |
| | | | |||||
| * | | add missing return | Ryan LeCompte | 2013-01-11 | 1 | -0/+1 |
| | | | |||||
| * | | attempt to sleep for more accurate time period, minor cleanup | Ryan LeCompte | 2013-01-11 | 1 | -8/+11 |
| | | | |||||
| * | | Merge pull request #350 from tdas/streaming | Matei Zaharia | 2013-01-07 | 42 | -307/+1535 |
| |\| | | | | | Spark Streaming | ||||
| | * | Changed locations for unit test logs. | Tathagata Das | 2013-01-07 | 1 | -2/+2 |
| | | | |||||
| | * | Added better docs for RDDCheckpointData | Tathagata Das | 2013-01-07 | 2 | -1/+13 |
| | | | |||||
| | * | Renamed examples and added documentation. | Tathagata Das | 2013-01-07 | 1 | -2/+2 |
| | | | |||||
| | * | Changed cleanup to clearOldValues for TimeStampedHashMap and TimeStampedHashSet. | Tathagata Das | 2013-01-07 | 7 | -12/+18 |
| | | | |||||
| | * | Fixed compilation bug in RDDSuite created during merge for mesos/master. | Tathagata Das | 2013-01-01 | 1 | -3/+3 |
| | | | |||||
| | * | Merge branch 'mesos' into dev-merge | Tathagata Das | 2013-01-01 | 10 | -47/+187 |
| | |\ | |||||
| | | * | Merge pull request #349 from woggling/cache-finally | Matei Zaharia | 2013-01-01 | 2 | -11/+28 |
| | | |\ | | | | | | | | | Avoid stalls when computation of cached RDD throws exception | ||||
| | | | * | Remove some dead comments | Charles Reiss | 2013-01-01 | 1 | -6/+0 |
| | | | | | |||||
| | | | * | Test with exception while computing cached RDD. | Charles Reiss | 2013-01-01 | 1 | -0/+23 |
| | | | | | |||||
| | | | * | Mark key as not loading in CacheTracker even when compute() fails | Charles Reiss | 2013-01-01 | 1 | -10/+10 |
| | | | | | |||||
| | | * | | Raise exception when hashing Java arrays (SPARK-597) | Josh Rosen | 2012-12-31 | 4 | -0/+58 |
| | | |/ | |||||
| | * | | Refactored a whole lot to push all DStreams into the spark.streaming.dstream ↵ | Tathagata Das | 2012-12-30 | 1 | -0/+1 |
| | | | | | | | | | | | | | package. | ||||
| | * | | Improved jekyll and scala docs. Made many classes and method private to ↵ | Tathagata Das | 2012-12-29 | 1 | -1/+0 |
| | | | | | | | | | | | | | remove them from scala docs. | ||||
| | * | | Modifications to make sure LocalScheduler terminate cleanly without errors ↵ | Tathagata Das | 2012-12-27 | 4 | -13/+21 |
| | | | | | | | | | | | | | when SparkContext is shutdown, to minimize spurious exception during master failure tests. | ||||
| | * | | Merge branch 'mesos' into dev-merge | Tathagata Das | 2012-12-26 | 5 | -142/+90 |
| | |\ \ | |||||
| | * \ \ | Merge branch 'dev-checkpoint' of github.com:radlab/spark into dev-merge | Tathagata Das | 2012-12-26 | 26 | -470/+921 |
| | |\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/ParallelCollection.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/CartesianRDD.scala core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/CoalescedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala core/src/main/scala/spark/rdd/FlatMappedRDD.scala core/src/main/scala/spark/rdd/GlommedRDD.scala core/src/main/scala/spark/rdd/HadoopRDD.scala core/src/main/scala/spark/rdd/MapPartitionsRDD.scala core/src/main/scala/spark/rdd/MapPartitionsWithSplitRDD.scala core/src/main/scala/spark/rdd/MappedRDD.scala core/src/main/scala/spark/rdd/PipedRDD.scala core/src/main/scala/spark/rdd/SampledRDD.scala core/src/main/scala/spark/rdd/ShuffledRDD.scala core/src/main/scala/spark/rdd/UnionRDD.scala core/src/main/scala/spark/scheduler/ResultTask.scala core/src/test/scala/spark/CheckpointSuite.scala | ||||
| | | * \ \ | Merge branch 'dev' of github.com:radlab/spark into dev-checkpoint | Tathagata Das | 2012-12-20 | 4 | -10/+29 |
| | | |\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/ParallelCollection.scala core/src/test/scala/spark/CheckpointSuite.scala streaming/src/main/scala/spark/streaming/DStream.scala | ||||
| | | * | | | | Fixed bugs in CheckpointRDD and spark.CheckpointSuite. | Tathagata Das | 2012-12-20 | 3 | -12/+9 |
| | | | | | | | |||||
| | | * | | | | Changed checkpoint writing and reading process. | Tathagata Das | 2012-12-20 | 3 | -25/+124 |
| | | | | | | | |||||
| | | * | | | | Introduced getSpits, getDependencies, and getPreferredLocations in RDD and ↵ | Tathagata Das | 2012-12-18 | 22 | -113/+134 |
| | | | | | | | | | | | | | | | | | | | | | | | | | RDDCheckpointData. | ||||
| | | * | | | | Converted CheckpointState in RDDCheckpointData to use scala Enumeration. | Tathagata Das | 2012-12-17 | 1 | -26/+22 |
| | | | | | | | |||||
| | | * | | | | Made checkpoint data in RDDs optional to further reduce serialized size. | Tathagata Das | 2012-12-11 | 3 | -14/+28 |
| | | | | | | | |||||
| | | * | | | | Fixed bug in UnionRDD and CoGroupedRDD | Tathagata Das | 2012-12-11 | 3 | -115/+10 |
| | | | | | | | |||||
| | | * | | | | Bunch of bug fixes related to checkpointing in RDDs. RDDCheckpointData ↵ | Tathagata Das | 2012-12-10 | 13 | -90/+389 |
| | | | | | | | | | | | | | | | | | | | | | | | | | object is used to lock all serialization and dependency changes for checkpointing. ResultTask converted to Externalizable and serialized RDD is cached like ShuffleMapTask. | ||||
| | | * | | | | Modified checkpoint testsuite to more comprehensively test checkpointing of ↵ | Tathagata Das | 2012-12-07 | 14 | -110/+285 |
| | | | | | | | | | | | | | | | | | | | | | | | | | various RDDs. Fixed checkpoint bug (splits referring to parent RDDs or parent splits) in UnionRDD and CoalescedRDD. Fixed bug in testing ShuffledRDD. Removed unnecessary and useless map-side combining step for narrow dependencies in CoGroupedRDD. Removed unncessary WeakReference stuff from many other RDDs. | ||||
| | | * | | | | Refactored RDD checkpointing to minimize extra fields in RDD class. | Tathagata Das | 2012-12-04 | 11 | -191/+140 |
| | | | | | | | |||||
| | * | | | | | Merge branch 'master' of github.com:mesos/spark into dev | Reynold Xin | 2012-12-20 | 71 | -850/+1940 |
| | |\ \ \ \ \ | | |_|/ / / | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/MapOutputTracker.scala core/src/main/scala/spark/PairRDDFunctions.scala core/src/main/scala/spark/ParallelCollection.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/CartesianRDD.scala core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/CoalescedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala core/src/main/scala/spark/rdd/FlatMappedRDD.scala core/src/main/scala/spark/rdd/GlommedRDD.scala core/src/main/scala/spark/rdd/HadoopRDD.scala core/src/main/scala/spark/rdd/MapPartitionsRDD.scala core/src/main/scala/spark/rdd/MapPartitionsWithSplitRDD.scala core/src/main/scala/spark/rdd/MappedRDD.scala core/src/main/scala/spark/rdd/PipedRDD.scala core/src/main/scala/spark/rdd/SampledRDD.scala core/src/main/scala/spark/rdd/ShuffledRDD.scala core/src/main/scala/spark/rdd/UnionRDD.scala core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/BlockManagerId.scala core/src/main/scala/spark/storage/BlockManagerMaster.scala core/src/main/scala/spark/storage/StorageLevel.scala core/src/main/scala/spark/util/MetadataCleaner.scala core/src/main/scala/spark/util/TimeStampedHashMap.scala core/src/test/scala/spark/storage/BlockManagerSuite.scala run | ||||
| | * | | | | | Added clear property to JavaAPISuite to remove port binding errors. | Tathagata Das | 2012-12-11 | 1 | -0/+2 |
| | | | | | | | |||||
| | * | | | | | Merge pull request #5 from radlab/flume-integration | Tathagata Das | 2012-12-09 | 2 | -3/+18 |
| | |\ \ \ \ \ | | | | | | | | | | | | | | | Flume integration | ||||
| | | * | | | | | Changes in response to TD's review. | Patrick Wendell | 2012-12-07 | 1 | -3/+3 |
| | | | | | | | | |||||
| | | * | | | | | Adding locality aware parallelize | Patrick Wendell | 2012-12-07 | 2 | -3/+18 |
| | | | |/ / / | | |/| | | | |||||
| | * / | | | | Removed unnecessary testcases. | Tathagata Das | 2012-12-08 | 1 | -4/+4 |
| | |/ / / / | |||||
| | * | | | | Added metadata cleaner to HttpBroadcast to clean up old broacast files. | Tathagata Das | 2012-12-03 | 1 | -0/+24 |
| | | | | | | |||||
| | * | | | | Made RDD checkpoint not create a new thread. Fixed bug in detecting when ↵ | Tathagata Das | 2012-12-02 | 2 | -22/+12 |
| | | | | | | | | | | | | | | | | | | | | | spark.cleaner.delay is insufficient. | ||||
| | * | | | | Minor modifications. | Tathagata Das | 2012-12-01 | 1 | -1/+6 |
| | | | | | | |||||
| | * | | | | Added TimeStampedHashSet and used that to cleanup the list of registered RDD ↵ | Tathagata Das | 2012-11-29 | 3 | -9/+81 |
| | | | | | | | | | | | | | | | | | | | | | IDs in CacheTracker. | ||||
| | * | | | | Added metadata cleaner to BlockManager to remove old blocks completely. | Tathagata Das | 2012-11-28 | 2 | -12/+36 |
| | | | | | | |||||
| | * | | | | Renamed CleanupTask to MetadataCleaner. | Tathagata Das | 2012-11-28 | 5 | -14/+15 |
| | | | | | | |||||
| | * | | | | Modified StorageLevel and BlockManagerId to cache common objects and use ↵ | Tathagata Das | 2012-11-28 | 4 | -29/+101 |
| | | | | | | | | | | | | | | | | | | | | | cached object while deserializing. | ||||
 |
index : spark | |
| Mirror of Apache Spark |
| aboutsummaryrefslogtreecommitdiff |