Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
| | * | | | | | | more code cleanup | Ryan LeCompte | 2013-01-13 | 1 | -31/+32 | |
| | | | | | | | | ||||||
| | * | | | | | | add comment | Ryan LeCompte | 2013-01-12 | 1 | -0/+1 | |
| | | | | | | | | ||||||
| | * | | | | | | add one extra test | Ryan LeCompte | 2013-01-12 | 1 | -0/+1 | |
| | | | | | | | | ||||||
| | * | | | | | | correct test params | Ryan LeCompte | 2013-01-12 | 1 | -2/+2 | |
| | | | | | | | | ||||||
| | * | | | | | | add unit test | Ryan LeCompte | 2013-01-11 | 2 | -1/+23 | |
| | | | | | | | | ||||||
| | * | | | | | | add missing return | Ryan LeCompte | 2013-01-11 | 1 | -0/+1 | |
| | | | | | | | | ||||||
| | * | | | | | | attempt to sleep for more accurate time period, minor cleanup | Ryan LeCompte | 2013-01-11 | 1 | -8/+11 | |
| |/ / / / / / | ||||||
| * | | | | | | Merge pull request #350 from tdas/streaming | Matei Zaharia | 2013-01-07 | 109 | -319/+7742 | |
| |\ \ \ \ \ \ | | | | | | | | | | | | | | | | | Spark Streaming | |||||
| * | | | | | | | Fix Accumulators in Java, and add a test for them | Matei Zaharia | 2013-01-05 | 4 | -13/+79 | |
| | | | | | | | | ||||||
| | | | | | * | | Fixed issue https://spark-project.atlassian.net/browse/STREAMING-29, along ↵ | Tathagata Das | 2013-01-19 | 4 | -17/+23 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | with updates to doc comments in SparkContext.checkpoint(). | |||||
| | | | | | * | | Merge branch 'master' into streaming | Tathagata Das | 2013-01-16 | 5 | -16/+111 | |
| | | | | | |\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/MapOutputTracker.scala | |||||
| | | | | | * | | | Disabled checkpoint for PairwiseRDD (pySpark). | Tathagata Das | 2013-01-16 | 1 | -0/+1 | |
| | | | | | | | | | ||||||
| | | | | | * | | | Merge branch 'master' into streaming | Tathagata Das | 2013-01-15 | 69 | -293/+3499 | |
| | | | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala docs/_layouts/global.html docs/index.md run | |||||
| | | | | * | | | | Fixed updateStateByKey to work with primitive types. | Tathagata Das | 2013-01-14 | 3 | -8/+8 | |
| | | | | | | | | | ||||||
| | | | | * | | | | Fixed bug in RDD checkpointing. | Tathagata Das | 2013-01-14 | 1 | -3/+3 | |
| | | | |/ / / / | ||||||
| | | | * | | | | Minor name fix | Tathagata Das | 2013-01-13 | 1 | -2/+2 | |
| | | | | | | | | ||||||
| | | | * | | | | Fixed bug | Tathagata Das | 2013-01-13 | 1 | -1/+3 | |
| | | | | | | | | ||||||
| | | | * | | | | Added documentation for PairDStreamFunctions. | Tathagata Das | 2013-01-13 | 5 | -50/+331 | |
| | | | | | | | | ||||||
| | | | * | | | | Removed stream id from the constructor of NetworkReceiver to make it easier ↵ | Tathagata Das | 2013-01-13 | 7 | -37/+76 | |
| | | |/ / / / | | | | | | | | | | | | | | | | | | | | | | for PluggableNetworkInputDStream. | |||||
| | | * | | | | Changed variable name form ***Time to ***Duration to keep things consistent. | Tathagata Das | 2013-01-09 | 26 | -186/+176 | |
| | | | | | | | ||||||
| | | * | | | | Split Time to Time (absolute instant of time) and Duration (duration of time). | Tathagata Das | 2013-01-09 | 25 | -152/+174 | |
| | | | | | | | ||||||
| | | * | | | | Making the Twitter example distributed. | Patrick Wendell | 2013-01-07 | 2 | -37/+62 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This adds a distributed (receiver-based) implementation of the Twitter dstream. It also changes the example to perform a distributed sort rather than collecting the dataset at one node. | |||||
| | | * | | | | Moved Twitter example to the where the other examples are. | Tathagata Das | 2013-01-07 | 2 | -10/+11 | |
| | | | | | | | ||||||
| | | * | | | | Merge branch 'streaming-merge' into dev-merge | Tathagata Das | 2013-01-07 | 3 | -1/+108 | |
| | | |\ \ \ \ | ||||||
| | | | * \ \ \ | Merge pull request #8 from radlab/twitter-example | Patrick Wendell | 2012-12-29 | 3 | -1/+108 | |
| | | | |\ \ \ \ | | | | | | | | | | | | | | | | | | | Adding a Twitter InputDStream with an example | |||||
| | | | | * | | | | Minor changes after review and general cleanup. | Patrick Wendell | 2012-12-21 | 2 | -11/+19 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Added filters to Twitter example - Removed un-used import - Some code clean-up | |||||
| | | | | * | | | | Adding a Twitter InputDStream with an example | Patrick Wendell | 2012-12-21 | 3 | -1/+100 | |
| | | | | | | | | | ||||||
| | | * | | | | | | Merge branch 'dev' into dev-merge | Tathagata Das | 2013-01-07 | 35 | -356/+181 | |
| | | |\ \ \ \ \ \ | | | |/ / / / / / | | |/| | | | | | | ||||||
| | * | | | | | | | Changed locations for unit test logs. | Tathagata Das | 2013-01-07 | 4 | -8/+8 | |
| | | | | | | | | | ||||||
| | * | | | | | | | Fixed bug | Tathagata Das | 2013-01-07 | 1 | -1/+1 | |
| | | | | | | | | | ||||||
| | * | | | | | | | Added better docs for RDDCheckpointData | Tathagata Das | 2013-01-07 | 2 | -1/+13 | |
| | | | | | | | | | ||||||
| | * | | | | | | | Renamed examples and added documentation. | Tathagata Das | 2013-01-07 | 15 | -304/+141 | |
| | | | | | | | | | ||||||
| | * | | | | | | | Changed cleanup to clearOldValues for TimeStampedHashMap and TimeStampedHashSet. | Tathagata Das | 2013-01-07 | 7 | -12/+18 | |
| | | | | | | | | | ||||||
| | * | | | | | | | Moved Spark Streaming examples to examples sub-project. | Tathagata Das | 2013-01-06 | 13 | -2/+1 | |
| | | | | | | | | | ||||||
| | * | | | | | | | Removed streaming-env.sh.template | Tathagata Das | 2013-01-06 | 3 | -29/+0 | |
| | | | | | | | | | ||||||
| | | * | | | | | | Merge branch 'dev-merge' of github.com:radlab/spark into dev-merge | Tathagata Das | 2013-01-07 | 5 | -99/+90 | |
| | |/| | | | | | | ||||||
| | | * | | | | | | Merge pull request #10 from radlab/datahandler-fix | Patrick Wendell | 2013-01-02 | 5 | -99/+90 | |
| | | |\ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | Several code-quality improvements to DataHandler. | |||||
| | | | * | | | | | | BufferingBlockCreator -> NetworkReceiver.BlockGenerator | Patrick Wendell | 2013-01-02 | 5 | -94/+89 | |
| | | | | | | | | | | ||||||
| | | | * | | | | | | Merge branch 'dev-merge' into datahandler-fix | Patrick Wendell | 2013-01-02 | 54 | -538/+919 | |
| | | | |\ \ \ \ \ \ | | | | |/ / / / / / | | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: streaming/src/main/scala/spark/streaming/dstream/DataHandler.scala | |||||
| | | | * | | | | | | Several code-quality improvements to DataHandler. | Patrick Wendell | 2013-01-02 | 5 | -88/+84 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Changed to more accurate name: BufferingBlockCreator - Docstring now correctly reflects the abstraction offered by the class - Made internal methods private - Fixed indentation problems | |||||
| | * | | | | | | | | Fixed compilation bug in RDDSuite created during merge for mesos/master. | Tathagata Das | 2013-01-01 | 1 | -3/+3 | |
| | | | | | | | | | | ||||||
| | * | | | | | | | | Merge branch 'mesos' into dev-merge | Tathagata Das | 2013-01-01 | 10 | -47/+187 | |
| | |\ \ \ \ \ \ \ \ | | | |/ / / / / / / | | |/| | | | | | | | ||||||
| | * | | | | | | | | Updated Streaming Programming Guide. | Tathagata Das | 2013-01-01 | 5 | -17/+179 | |
| | | | | | | | | | | ||||||
| | * | | | | | | | | More classes made private[streaming] to hide from scala docs. | Tathagata Das | 2012-12-30 | 18 | -52/+137 | |
| | | | | | | | | | | ||||||
| | * | | | | | | | | Refactored a whole lot to push all DStreams into the spark.streaming.dstream ↵ | Tathagata Das | 2012-12-30 | 41 | -333/+402 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | package. | |||||
| | * | | | | | | | | Improved jekyll and scala docs. Made many classes and method private to ↵ | Tathagata Das | 2012-12-29 | 19 | -168/+233 | |
| | | |/ / / / / / | | |/| | | | | | | | | | | | | | | | | | | | | | | | | remove them from scala docs. | |||||
| | * | | | | | | | Modifications to make sure LocalScheduler terminate cleanly without errors ↵ | Tathagata Das | 2012-12-27 | 5 | -18/+29 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | when SparkContext is shutdown, to minimize spurious exception during master failure tests. | |||||
| | * | | | | | | | Merge branch 'mesos' into dev-merge | Tathagata Das | 2012-12-26 | 8 | -158/+108 | |
| | |\ \ \ \ \ \ \ | ||||||
| | * \ \ \ \ \ \ \ | Merge branch 'dev-checkpoint' of github.com:radlab/spark into dev-merge | Tathagata Das | 2012-12-26 | 27 | -479/+930 | |
| | |\ \ \ \ \ \ \ \ | | | |_|_|/ / / / / | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/ParallelCollection.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/CartesianRDD.scala core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/CoalescedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala core/src/main/scala/spark/rdd/FlatMappedRDD.scala core/src/main/scala/spark/rdd/GlommedRDD.scala core/src/main/scala/spark/rdd/HadoopRDD.scala core/src/main/scala/spark/rdd/MapPartitionsRDD.scala core/src/main/scala/spark/rdd/MapPartitionsWithSplitRDD.scala core/src/main/scala/spark/rdd/MappedRDD.scala core/src/main/scala/spark/rdd/PipedRDD.scala core/src/main/scala/spark/rdd/SampledRDD.scala core/src/main/scala/spark/rdd/ShuffledRDD.scala core/src/main/scala/spark/rdd/UnionRDD.scala core/src/main/scala/spark/scheduler/ResultTask.scala core/src/test/scala/spark/CheckpointSuite.scala | |||||
| | | * | | | | | | | Merge branch 'dev' of github.com:radlab/spark into dev-checkpoint | Tathagata Das | 2012-12-20 | 19 | -122/+717 | |
| | | |\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/ParallelCollection.scala core/src/test/scala/spark/CheckpointSuite.scala streaming/src/main/scala/spark/streaming/DStream.scala |