aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
| | * | | | | | more code cleanupRyan LeCompte2013-01-131-31/+32
| | | | | | | |
| | * | | | | | add commentRyan LeCompte2013-01-121-0/+1
| | | | | | | |
| | * | | | | | add one extra testRyan LeCompte2013-01-121-0/+1
| | | | | | | |
| | * | | | | | correct test paramsRyan LeCompte2013-01-121-2/+2
| | | | | | | |
| | * | | | | | add unit testRyan LeCompte2013-01-112-1/+23
| | | | | | | |
| | * | | | | | add missing returnRyan LeCompte2013-01-111-0/+1
| | | | | | | |
| | * | | | | | attempt to sleep for more accurate time period, minor cleanupRyan LeCompte2013-01-111-8/+11
| |/ / / / / /
| * | | | | | Merge pull request #350 from tdas/streamingMatei Zaharia2013-01-07109-319/+7742
| |\ \ \ \ \ \ | | | | | | | | | | | | | | | | Spark Streaming
| * | | | | | | Fix Accumulators in Java, and add a test for themMatei Zaharia2013-01-054-13/+79
| | | | | | | |
| | | | | | * | Fixed issue https://spark-project.atlassian.net/browse/STREAMING-29, along ↵Tathagata Das2013-01-194-17/+23
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | with updates to doc comments in SparkContext.checkpoint().
| | | | | | * | Merge branch 'master' into streamingTathagata Das2013-01-165-16/+111
| | | | | | |\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/MapOutputTracker.scala
| | | | | | * | | Disabled checkpoint for PairwiseRDD (pySpark).Tathagata Das2013-01-161-0/+1
| | | | | | | | |
| | | | | | * | | Merge branch 'master' into streamingTathagata Das2013-01-1569-293/+3499
| | | | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala docs/_layouts/global.html docs/index.md run
| | | | | * | | | Fixed updateStateByKey to work with primitive types.Tathagata Das2013-01-143-8/+8
| | | | | | | | |
| | | | | * | | | Fixed bug in RDD checkpointing.Tathagata Das2013-01-141-3/+3
| | | | |/ / / /
| | | | * | | | Minor name fixTathagata Das2013-01-131-2/+2
| | | | | | | |
| | | | * | | | Fixed bugTathagata Das2013-01-131-1/+3
| | | | | | | |
| | | | * | | | Added documentation for PairDStreamFunctions.Tathagata Das2013-01-135-50/+331
| | | | | | | |
| | | | * | | | Removed stream id from the constructor of NetworkReceiver to make it easier ↵Tathagata Das2013-01-137-37/+76
| | | |/ / / / | | | | | | | | | | | | | | | | | | | | | for PluggableNetworkInputDStream.
| | | * | | | Changed variable name form ***Time to ***Duration to keep things consistent.Tathagata Das2013-01-0926-186/+176
| | | | | | |
| | | * | | | Split Time to Time (absolute instant of time) and Duration (duration of time).Tathagata Das2013-01-0925-152/+174
| | | | | | |
| | | * | | | Making the Twitter example distributed.Patrick Wendell2013-01-072-37/+62
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This adds a distributed (receiver-based) implementation of the Twitter dstream. It also changes the example to perform a distributed sort rather than collecting the dataset at one node.
| | | * | | | Moved Twitter example to the where the other examples are.Tathagata Das2013-01-072-10/+11
| | | | | | |
| | | * | | | Merge branch 'streaming-merge' into dev-mergeTathagata Das2013-01-073-1/+108
| | | |\ \ \ \
| | | | * \ \ \ Merge pull request #8 from radlab/twitter-examplePatrick Wendell2012-12-293-1/+108
| | | | |\ \ \ \ | | | | | | | | | | | | | | | | | | Adding a Twitter InputDStream with an example
| | | | | * | | | Minor changes after review and general cleanup.Patrick Wendell2012-12-212-11/+19
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Added filters to Twitter example - Removed un-used import - Some code clean-up
| | | | | * | | | Adding a Twitter InputDStream with an examplePatrick Wendell2012-12-213-1/+100
| | | | | | | | |
| | | * | | | | | Merge branch 'dev' into dev-mergeTathagata Das2013-01-0735-356/+181
| | | |\ \ \ \ \ \ | | | |/ / / / / / | | |/| | | | | |
| | * | | | | | | Changed locations for unit test logs.Tathagata Das2013-01-074-8/+8
| | | | | | | | |
| | * | | | | | | Fixed bugTathagata Das2013-01-071-1/+1
| | | | | | | | |
| | * | | | | | | Added better docs for RDDCheckpointDataTathagata Das2013-01-072-1/+13
| | | | | | | | |
| | * | | | | | | Renamed examples and added documentation.Tathagata Das2013-01-0715-304/+141
| | | | | | | | |
| | * | | | | | | Changed cleanup to clearOldValues for TimeStampedHashMap and TimeStampedHashSet.Tathagata Das2013-01-077-12/+18
| | | | | | | | |
| | * | | | | | | Moved Spark Streaming examples to examples sub-project.Tathagata Das2013-01-0613-2/+1
| | | | | | | | |
| | * | | | | | | Removed streaming-env.sh.templateTathagata Das2013-01-063-29/+0
| | | | | | | | |
| | | * | | | | | Merge branch 'dev-merge' of github.com:radlab/spark into dev-mergeTathagata Das2013-01-075-99/+90
| | |/| | | | | |
| | | * | | | | | Merge pull request #10 from radlab/datahandler-fixPatrick Wendell2013-01-025-99/+90
| | | |\ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | Several code-quality improvements to DataHandler.
| | | | * | | | | | BufferingBlockCreator -> NetworkReceiver.BlockGeneratorPatrick Wendell2013-01-025-94/+89
| | | | | | | | | |
| | | | * | | | | | Merge branch 'dev-merge' into datahandler-fixPatrick Wendell2013-01-0254-538/+919
| | | | |\ \ \ \ \ \ | | | | |/ / / / / / | | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: streaming/src/main/scala/spark/streaming/dstream/DataHandler.scala
| | | | * | | | | | Several code-quality improvements to DataHandler.Patrick Wendell2013-01-025-88/+84
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Changed to more accurate name: BufferingBlockCreator - Docstring now correctly reflects the abstraction offered by the class - Made internal methods private - Fixed indentation problems
| | * | | | | | | | Fixed compilation bug in RDDSuite created during merge for mesos/master.Tathagata Das2013-01-011-3/+3
| | | | | | | | | |
| | * | | | | | | | Merge branch 'mesos' into dev-mergeTathagata Das2013-01-0110-47/+187
| | |\ \ \ \ \ \ \ \ | | | |/ / / / / / / | | |/| | | | | | |
| | * | | | | | | | Updated Streaming Programming Guide.Tathagata Das2013-01-015-17/+179
| | | | | | | | | |
| | * | | | | | | | More classes made private[streaming] to hide from scala docs.Tathagata Das2012-12-3018-52/+137
| | | | | | | | | |
| | * | | | | | | | Refactored a whole lot to push all DStreams into the spark.streaming.dstream ↵Tathagata Das2012-12-3041-333/+402
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | package.
| | * | | | | | | | Improved jekyll and scala docs. Made many classes and method private to ↵Tathagata Das2012-12-2919-168/+233
| | | |/ / / / / / | | |/| | | | | | | | | | | | | | | | | | | | | | | | remove them from scala docs.
| | * | | | | | | Modifications to make sure LocalScheduler terminate cleanly without errors ↵Tathagata Das2012-12-275-18/+29
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | when SparkContext is shutdown, to minimize spurious exception during master failure tests.
| | * | | | | | | Merge branch 'mesos' into dev-mergeTathagata Das2012-12-268-158/+108
| | |\ \ \ \ \ \ \
| | * \ \ \ \ \ \ \ Merge branch 'dev-checkpoint' of github.com:radlab/spark into dev-mergeTathagata Das2012-12-2627-479/+930
| | |\ \ \ \ \ \ \ \ | | | |_|_|/ / / / / | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/ParallelCollection.scala core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/rdd/BlockRDD.scala core/src/main/scala/spark/rdd/CartesianRDD.scala core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/CoalescedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala core/src/main/scala/spark/rdd/FlatMappedRDD.scala core/src/main/scala/spark/rdd/GlommedRDD.scala core/src/main/scala/spark/rdd/HadoopRDD.scala core/src/main/scala/spark/rdd/MapPartitionsRDD.scala core/src/main/scala/spark/rdd/MapPartitionsWithSplitRDD.scala core/src/main/scala/spark/rdd/MappedRDD.scala core/src/main/scala/spark/rdd/PipedRDD.scala core/src/main/scala/spark/rdd/SampledRDD.scala core/src/main/scala/spark/rdd/ShuffledRDD.scala core/src/main/scala/spark/rdd/UnionRDD.scala core/src/main/scala/spark/scheduler/ResultTask.scala core/src/test/scala/spark/CheckpointSuite.scala
| | | * | | | | | | Merge branch 'dev' of github.com:radlab/spark into dev-checkpointTathagata Das2012-12-2019-122/+717
| | | |\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/ParallelCollection.scala core/src/test/scala/spark/CheckpointSuite.scala streaming/src/main/scala/spark/streaming/DStream.scala