aboutsummaryrefslogtreecommitdiff
path: root/streaming/src/main
Commit message (Expand)AuthorAgeFilesLines
* Merge branch 'streaming' into ScrapCode-streamingTathagata Das2013-02-1826-593/+1392
|\
| * Added checkpointing and fault-tolerance semantics to the programming guide. F...Tathagata Das2013-02-185-5/+10
| * Many changes to ensure better 2nd recovery if 2nd failure happens whileTathagata Das2013-02-1711-68/+141
| * Made MasterFailureTest more robust.Tathagata Das2013-02-151-4/+22
| * Moved Java streaming examples to examples/src/main/java/spark/streaming/... a...Tathagata Das2013-02-141-1/+1
| * Added TwitterInputDStream from example to StreamingContext. Renamed example T...Tathagata Das2013-02-142-17/+105
| * Removed countByKeyAndWindow on paired DStreams, and added countByValueAndWind...Tathagata Das2013-02-145-128/+173
| * Changes functions comments to make them more consistent.Tathagata Das2013-02-132-45/+45
| * Added filter functionality to reduceByKeyAndWindow with inverse. Consolidated...Tathagata Das2013-02-135-64/+68
| * Changed scheduler and file input stream to fix bugs in the driver fault toler...Tathagata Das2013-02-1310-104/+557
| * Fixed bugs in FileInputDStream and Scheduler that occasionally failed to repr...Tathagata Das2013-02-105-10/+21
| * Added an initial spark job to ensure worker nodes are initialized.Tathagata Das2013-02-091-1/+6
| * Merge branch 'mesos-master' into streamingTathagata Das2013-02-075-9/+18
| |\
| | * Streaming constructor which takes JavaSparkContextPatrick Wendell2013-02-051-0/+8
| | * Merge pull request #415 from stephenh/driverMatei Zaharia2013-01-291-2/+2
| | |\
| | | * Replace old 'master' term with 'driver'.Stephen Haberman2013-01-251-2/+2
| | * | Fix code that depended on metadata cleaner interval being in minutesMatei Zaharia2013-01-282-5/+5
| | |/
| | * Refactor daemon thread pool creation.Josh Rosen2013-01-211-2/+3
| * | Updated JavaStreamingContext with updated kafkaStream API.Tathagata Das2013-02-071-17/+9
| * | Merge branch 'mesos-streaming' into streamingTathagata Das2013-02-073-88/+41
| |\ \
| | * \ Merge pull request #372 from Reinvigorate/sm-kafkaTathagata Das2013-02-072-91/+13
| | |\ \
| | | * | kafkaStream API cleanup. A quorum of zookeepers can now be specifiedseanm2013-01-182-15/+10
| | | * | further KafkaInputDStream cleanup (removing unused and commented out code rel...seanm2013-01-181-69/+3
| | | * | Removing offset management code that is non-existent in kafka 0.7.0+seanm2013-01-141-7/+0
| | * | | Merge pull request #373 from Reinvigorate/sm-updateStateByKeyTathagata Das2013-02-072-6/+28
| | |\ \ \ | | | |_|/ | | |/| |
| | | * | Splitting StreamingContext.queueStream into two methodsseanm2013-01-201-4/+18
| | | * | Merge branch 'streaming' into sm-updateStateByKeyseanm2013-01-152-5/+5
| | | |\ \
| | | * | | StateDStream changes to give updateStateByKey consistent behaviorseanm2013-01-141-2/+10
| | | | |/ | | | |/|
| * | | | Added support for rescheduling unprocessed batches on master failure.Tathagata Das2013-01-234-5/+37
| * | | | Added support for saving input files of FileInputDStream to graph checkpoints...Tathagata Das2013-01-225-46/+115
| * | | | Refactored DStreamCheckpointData.Tathagata Das2013-01-223-58/+93
| |/ / /
| * | | Merge branch 'mesos-streaming' into streamingTathagata Das2013-01-206-120/+1360
| |\ \ \
| * | | | Fixed issue https://spark-project.atlassian.net/browse/STREAMING-29, along wi...Tathagata Das2013-01-191-1/+7
| | |_|/ | |/| |
| * | | Fixed updateStateByKey to work with primitive types.Tathagata Das2013-01-142-5/+5
| | |/ | |/|
* | | Plug in actor as stream receiver APIPrashant Sharma2013-01-193-0/+152
* | | Changed method name of createReceiver to getReceiver as it is not intended to...Prashant Sharma2013-01-196-28/+28
| |/ |/|
* | Adding queueStream and some slight refactoringPatrick Wendell2013-01-171-0/+58
* | Import fixupPatrick Wendell2013-01-172-2/+0
* | Style cleanupPatrick Wendell2013-01-173-3/+26
* | Checkpointing in Streaming java APIPatrick Wendell2013-01-171-2/+17
* | Adding flatMapPatrick Wendell2013-01-171-0/+29
* | Adding other updateState functionsPatrick Wendell2013-01-171-13/+49
* | Bug fix and test cleanupPatrick Wendell2013-01-171-2/+2
* | StashPatrick Wendell2013-01-141-1/+28
* | BugfixPatrick Wendell2013-01-141-2/+4
* | Remove AnyRef constraint in updateStatePatrick Wendell2013-01-142-5/+5
* | Bug fixPatrick Wendell2013-01-141-2/+1
* | Making comments consistent w/ Spark stylePatrick Wendell2013-01-145-232/+196
* | Two changes:Patrick Wendell2013-01-142-5/+269
* | Some style cleanupPatrick Wendell2013-01-142-53/+93