aboutsummaryrefslogtreecommitdiff
path: root/streaming/src
Commit message (Collapse)AuthorAgeFilesLines
...
| * | Adding some initial tests to streaming API.Patrick Wendell2013-01-143-3/+79
| | |
| * | A very rough, early cut at some Java functionality for Streaming.Patrick Wendell2013-01-143-0/+188
| | |
* | | Fixed issue https://spark-project.atlassian.net/browse/STREAMING-29, along ↵Tathagata Das2013-01-191-1/+7
| |/ |/| | | | | with updates to doc comments in SparkContext.checkpoint().
* | Fixed updateStateByKey to work with primitive types.Tathagata Das2013-01-143-8/+8
|/
* Minor name fixTathagata Das2013-01-131-2/+2
|
* Fixed bugTathagata Das2013-01-131-1/+3
|
* Added documentation for PairDStreamFunctions.Tathagata Das2013-01-133-27/+303
|
* Removed stream id from the constructor of NetworkReceiver to make it easier ↵Tathagata Das2013-01-136-30/+68
| | | | for PluggableNetworkInputDStream.
* Changed variable name form ***Time to ***Duration to keep things consistent.Tathagata Das2013-01-0926-186/+176
|
* Split Time to Time (absolute instant of time) and Duration (duration of time).Tathagata Das2013-01-0925-152/+174
|
* Moved Twitter example to the where the other examples are.Tathagata Das2013-01-072-104/+0
|
* Merge branch 'streaming-merge' into dev-mergeTathagata Das2013-01-072-0/+104
|\
| * Merge pull request #8 from radlab/twitter-examplePatrick Wendell2012-12-292-0/+104
| |\ | | | | | | Adding a Twitter InputDStream with an example
| | * Minor changes after review and general cleanup.Patrick Wendell2012-12-212-11/+19
| | | | | | | | | | | | | | | | | | - Added filters to Twitter example - Removed un-used import - Some code clean-up
| | * Adding a Twitter InputDStream with an examplePatrick Wendell2012-12-212-0/+96
| | |
* | | Merge branch 'dev' into dev-mergeTathagata Das2013-01-0716-639/+37
|\ \ \
| * | | Changed locations for unit test logs.Tathagata Das2013-01-071-2/+2
| | | |
| * | | Fixed bugTathagata Das2013-01-071-1/+1
| | | |
| * | | Renamed examples and added documentation.Tathagata Das2013-01-073-21/+35
| | | |
| * | | Moved Spark Streaming examples to examples sub-project.Tathagata Das2013-01-0612-616/+0
| | | |
* | | | BufferingBlockCreator -> NetworkReceiver.BlockGeneratorPatrick Wendell2013-01-025-94/+89
| | | |
* | | | Merge branch 'dev-merge' into datahandler-fixPatrick Wendell2013-01-0246-507/+721
|\| | | | | | | | | | | | | | | | | | | Conflicts: streaming/src/main/scala/spark/streaming/dstream/DataHandler.scala
| * | | Updated Streaming Programming Guide.Tathagata Das2013-01-011-0/+1
| | | |
| * | | More classes made private[streaming] to hide from scala docs.Tathagata Das2012-12-3017-52/+135
| | | |
| * | | Refactored a whole lot to push all DStreams into the spark.streaming.dstream ↵Tathagata Das2012-12-3040-333/+401
| | | | | | | | | | | | | | | | package.
| * | | Improved jekyll and scala docs. Made many classes and method private to ↵Tathagata Das2012-12-2916-139/+201
| | | | | | | | | | | | | | | | remove them from scala docs.
* | | | Several code-quality improvements to DataHandler.Patrick Wendell2013-01-025-88/+84
|/ / / | | | | | | | | | | | | | | | | | | | | | - Changed to more accurate name: BufferingBlockCreator - Docstring now correctly reflects the abstraction offered by the class - Made internal methods private - Fixed indentation problems
* | | Modifications to make sure LocalScheduler terminate cleanly without errors ↵Tathagata Das2012-12-271-5/+8
| | | | | | | | | | | | when SparkContext is shutdown, to minimize spurious exception during master failure tests.
* | | Merge branch 'dev' of github.com:radlab/spark into dev-checkpointTathagata Das2012-12-2013-110/+683
|\| | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/ParallelCollection.scala core/src/test/scala/spark/CheckpointSuite.scala streaming/src/main/scala/spark/streaming/DStream.scala
| * | Changes in response to TD's review.Patrick Wendell2012-12-076-15/+29
| | |
| * | Adding Flume InputDStreamPatrick Wendell2012-12-078-6/+246
| |/
| * Adjust Kafka code to work with new streaming changes.Denny2012-12-052-4/+5
| |
| * Merge branch 'dev' into kafkaDenny2012-12-0522-109/+139
| |\ | | | | | | | | | | | | Conflicts: streaming/src/main/scala/spark/streaming/DStream.scala
| * | Added Kafka Wordcount producerDenny2012-11-192-25/+52
| | |
| * | Comment out code for fault-tolerance.Denny2012-11-191-17/+18
| | |
| * | Merge branch 'dev' into kafkaDenny2012-11-194-3/+173
| |\ \
| * \ \ Merge branch 'dev' into kafkaDenny2012-11-139-123/+155
| |\ \ \ | | | | | | | | | | | | | | | | | | | | Conflicts: streaming/src/main/scala/spark/streaming/DStream.scala
| * | | | change import for example functionDenny2012-11-131-1/+1
| | | | |
| * | | | Merge branch 'dev' into kafkaDenny2012-11-1226-2055/+331
| |\ \ \ \
| * | | | | Updated comment.Denny2012-11-111-1/+1
| | | | | |
| * | | | | Add comment.Denny2012-11-111-0/+2
| | | | | |
| * | | | | Kafka Stream comments.Denny2012-11-115-53/+99
| | | | | |
| * | | | | Merge branch 'dev' of github.com:radlab/spark into kafkaDenny2012-11-098-50/+263
| |\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: streaming/src/main/scala/spark/streaming/DStream.scala
| * | | | | | Kafka Stream.Denny2012-11-099-161/+245
| | | | | | |
| * | | | | | Merge branch 'dev' of github.com:radlab/spark into kafkaDenny2012-11-0616-237/+545
| |\ \ \ \ \ \
| * | | | | | | Working on kafka.Denny2012-11-063-0/+159
| | | | | | | |
* | | | | | | | Made checkpoint data in RDDs optional to further reduce serialized size.Tathagata Das2012-12-111-3/+1
| | | | | | | |
* | | | | | | | Refactored RDD checkpointing to minimize extra fields in RDD class.Tathagata Das2012-12-041-3/+4
| |_|_|_|_|_|/ |/| | | | | |
* | | | | | | Minor modsTathagata Das2012-12-021-1/+1
| | | | | | |
* | | | | | | Made RDD checkpoint not create a new thread. Fixed bug in detecting when ↵Tathagata Das2012-12-021-4/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | | | spark.cleaner.delay is insufficient.
generated by cgit v1.2.3 (git 2.39.1) at 2024-08-23 07:24:01 +0000