aboutsummaryrefslogtreecommitdiff
path: root/streaming/src/main
Commit message (Expand)AuthorAgeFilesLines
* Several code-quality improvements to DataHandler.Patrick Wendell2013-01-025-88/+84
* Merge branch 'dev' of github.com:radlab/spark into dev-checkpointTathagata Das2012-12-2011-102/+620
|\
| * Changes in response to TD's review.Patrick Wendell2012-12-076-15/+29
| * Adding Flume InputDStreamPatrick Wendell2012-12-077-4/+189
| * Adjust Kafka code to work with new streaming changes.Denny2012-12-052-4/+5
| * Merge branch 'dev' into kafkaDenny2012-12-0518-95/+131
| |\
| * | Added Kafka Wordcount producerDenny2012-11-192-25/+52
| * | Comment out code for fault-tolerance.Denny2012-11-191-17/+18
| * | Merge branch 'dev' into kafkaDenny2012-11-194-3/+173
| |\ \
| * \ \ Merge branch 'dev' into kafkaDenny2012-11-136-69/+94
| |\ \ \
| * | | | change import for example functionDenny2012-11-131-1/+1
| * | | | Merge branch 'dev' into kafkaDenny2012-11-1224-2027/+197
| |\ \ \ \
| * | | | | Updated comment.Denny2012-11-111-1/+1
| * | | | | Add comment.Denny2012-11-111-0/+2
| * | | | | Kafka Stream comments.Denny2012-11-114-47/+93
| * | | | | Merge branch 'dev' of github.com:radlab/spark into kafkaDenny2012-11-094-12/+27
| |\ \ \ \ \
| * | | | | | Kafka Stream.Denny2012-11-099-161/+245
| * | | | | | Merge branch 'dev' of github.com:radlab/spark into kafkaDenny2012-11-0613-190/+317
| |\ \ \ \ \ \
| * | | | | | | Working on kafka.Denny2012-11-063-0/+159
* | | | | | | | Made checkpoint data in RDDs optional to further reduce serialized size.Tathagata Das2012-12-111-3/+1
* | | | | | | | Refactored RDD checkpointing to minimize extra fields in RDD class.Tathagata Das2012-12-041-3/+4
| |_|_|_|_|_|/ |/| | | | | |
* | | | | | | Minor modsTathagata Das2012-12-021-1/+1
* | | | | | | Made RDD checkpoint not create a new thread. Fixed bug in detecting when spar...Tathagata Das2012-12-021-4/+5
* | | | | | | Minor modifications.Tathagata Das2012-12-013-5/+22
* | | | | | | Added ssc.unionTathagata Das2012-12-012-1/+6
* | | | | | | Bug fixesTathagata Das2012-11-281-1/+1
* | | | | | | Modified bunch HashMaps in Spark to use TimeStampedHashMap and made various m...Tathagata Das2012-11-271-4/+9
* | | | | | | Modified StreamingContext API to make constructor accept the batch size (sinc...Tathagata Das2012-11-1913-85/+85
* | | | | | | Fixed bug in the number of splits in RDD after checkpointing. Modified reduce...Tathagata Das2012-11-194-3/+11
| |_|_|_|_|/ |/| | | | |
* | | | | | Merge branch 'dev' of github.com:radlab/spark into devTathagata Das2012-11-172-0/+170
|\ \ \ \ \ \
| * \ \ \ \ \ Merge pull request #4 from radlab/streaming-examplePatrick Wendell2012-11-162-0/+170
| |\ \ \ \ \ \ | | |_|_|_|_|/ | |/| | | | |
| | * | | | | A "streaming page view" example.Patrick Wendell2012-11-162-0/+170
| | |/ / / /
* | / / / / Fixed checkpointing bug in CoGroupedRDD. CoGroupSplits kept around the RDD sp...Tathagata Das2012-11-172-3/+3
|/ / / / /
* | | | | Fixed bug in MappedValuesRDD, and set default graph checkpoint interval to be...Tathagata Das2012-11-133-5/+22
* | | | | Replaced StateRDD in StateDStream with MapPartitionsRDD.Tathagata Das2012-11-131-12/+3
* | | | | Optimized checkpoint writing by reusing FileSystem object. Fixed bug in updat...Tathagata Das2012-11-134-52/+67
| |_|_|/ |/| | |
* | | | Changed default level on calling DStream.persist() to be MEMORY_ONLY_SER. Als...Tathagata Das2012-11-122-2/+2
* | | | Fixed bugs in RawNetworkInputDStream and in its examples. Made the ReducedWin...Tathagata Das2012-11-1211-376/+167
* | | | Merge branch 'dev' of github.com:radlab/spark into devtdas2012-11-111-6/+28
|\ \ \ \
| * | | | Fixed bug in FileInputDStream that allowed it to miss new files. Added tests ...Tathagata Das2012-11-111-6/+28
| | |_|/ | |/| |
* / | | Removed unnecessary files.tdas2012-11-0810-1643/+0
|/ / /
* | | Added FailureTestsuite for testing multiple, repeated master failures.Tathagata Das2012-11-064-11/+22
* | | Added a few more comments to the checkpoint-related functions.Tathagata Das2012-11-051-0/+8
| |/ |/|
* | Made more bug fixes for checkpointing.Tathagata Das2012-11-055-39/+47
* | Fixed major bugs in checkpointing.Tathagata Das2012-11-055-40/+76
* | Made checkpointing of dstream graph to work with checkpointing of RDDs. For s...Tathagata Das2012-11-0412-162/+245
|/
* Fixed serialization bug in countByWindow, added countByKey and countByKeyAndW...Tathagata Das2012-11-022-5/+22
* Added save operations to DStreams.Tathagata Das2012-10-273-3/+84
* Merge branch 'dev' of github.com:radlab/spark into devTathagata Das2012-10-2515-22/+28
|\
| * Merge remote-tracking branch 'public/master' into devMatei Zaharia2012-10-2415-22/+28