aboutsummaryrefslogtreecommitdiff
path: root/streaming
Commit message (Collapse)AuthorAgeFilesLines
...
| | | * Streaming constructor which takes JavaSparkContextPatrick Wendell2013-02-051-0/+8
| | | | | | | | | | | | | | | | | | | | It's sometimes helpful to directly pass a JavaSparkContext, and take advantage of the various constructors available for that.
| | | * Remove activation of profiles by defaultMikhail Bautin2013-01-311-11/+0
| | | | | | | | | | | | | | | | | | | | See the discussion at https://github.com/mesos/spark/pull/355 for why default profile activation is a problem.
| | | * Merge pull request #415 from stephenh/driverMatei Zaharia2013-01-297-8/+8
| | | |\ | | | | | | | | | | Replace old 'master' term with 'driver'.
| | | | * Replace old 'master' term with 'driver'.Stephen Haberman2013-01-257-8/+8
| | | | |
| | | * | Fix code that depended on metadata cleaner interval being in minutesMatei Zaharia2013-01-282-5/+5
| | | |/
| | | * Refactor daemon thread pool creation.Josh Rosen2013-01-211-2/+3
| | | |
| | | * Move JavaAPISuite into spark.streaming.Stephen Haberman2013-01-212-0/+0
| | | |
| | | * Add Maven build file for streaming, and fix some issues in SBT fileMatei Zaharia2013-01-2010-0/+182
| | | | | | | | | | | | | | | | | | | | | | | | As part of this, changed our Scala 2.9.2 Kafka library to be available as a local Maven repository, following the example in (http://blog.dub.podval.org/2010/01/maven-in-project-repository.html)
| | * | Updated JavaStreamingContext with updated kafkaStream API.Tathagata Das2013-02-071-17/+9
| | | |
| | * | Merge branch 'mesos-streaming' into streamingTathagata Das2013-02-075-88/+91
| | |\ \
| | | * \ Merge pull request #372 from Reinvigorate/sm-kafkaTathagata Das2013-02-072-91/+13
| | | |\ \ | | | | | | | | | | | | Removing offset management code that is non-existent in kafka 0.7.0+
| | | | * | kafkaStream API cleanup. A quorum of zookeepers can now be specifiedseanm2013-01-182-15/+10
| | | | | |
| | | | * | further KafkaInputDStream cleanup (removing unused and commented out code ↵seanm2013-01-181-69/+3
| | | | | | | | | | | | | | | | | | | | | | | | relating to offset management)
| | | | * | Removing offset management code that is non-existent in kafka 0.7.0+seanm2013-01-141-7/+0
| | | | | |
| | | * | | Merge pull request #373 from Reinvigorate/sm-updateStateByKeyTathagata Das2013-02-074-6/+78
| | | |\ \ \ | | | | |_|/ | | | |/| | StateDStream changes to give updateStateByKey consistent behavior
| | | | * | Splitting StreamingContext.queueStream into two methodsseanm2013-01-201-4/+18
| | | | | |
| | | | * | adding updateStateByKey object lifecycle testseanm2013-01-202-0/+50
| | | | | |
| | | | * | Merge branch 'streaming' into sm-updateStateByKeyseanm2013-01-153-8/+8
| | | | |\ \
| | | | * | | StateDStream changes to give updateStateByKey consistent behaviorseanm2013-01-141-2/+10
| | | | | |/ | | | | |/|
| | * | | | Fixed checkpoint testcasesTathagata Das2013-01-233-172/+129
| | | | | |
| | * | | | Added support for rescheduling unprocessed batches on master failure.Tathagata Das2013-01-235-12/+53
| | | | | |
| | * | | | Added support for saving input files of FileInputDStream to graph ↵Tathagata Das2013-01-226-66/+159
| | | | | | | | | | | | | | | | | | | | | | | | checkpoints. Modified 'file input stream with checkpoint' testcase to test recovery of pre-master-failure input files.
| | * | | | Refactored DStreamCheckpointData.Tathagata Das2013-01-224-64/+99
| | |/ / /
| * | | | Plug in actor as stream receiver APIPrashant Sharma2013-01-193-0/+152
| | | | |
| * | | | Changed method name of createReceiver to getReceiver as it is not intended ↵Prashant Sharma2013-01-196-28/+28
| | | | | | | | | | | | | | | | | | | | to be a factory.
* | | | | actor as receiverPrashant Sharma2013-01-224-0/+269
| | | | |
* | | | | Changed method name of createReceiver to getReceiver as it is not intended ↵Prashant Sharma2013-01-216-8/+8
| |/ / / |/| | | | | | | | | | | to be a factory.
* | | | Fixed streaming testsuite bugsTathagata Das2013-01-207-6/+24
| | | |
* | | | Merge branch 'mesos-streaming' into streamingTathagata Das2013-01-208-120/+2452
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/api/java/JavaRDDLike.scala core/src/main/scala/spark/api/java/JavaSparkContext.scala core/src/test/scala/spark/JavaAPISuite.java
| * | | Moving tests to appropriate directoryPatrick Wendell2013-01-172-0/+0
| | | |
| * | | Adding queueStream and some slight refactoringPatrick Wendell2013-01-172-81/+163
| | | |
| * | | Merge branch 'streaming' into streaming-java-apiPatrick Wendell2013-01-171-3/+3
| |\ \ \ | | | |/ | | |/|
| * | | Import fixupPatrick Wendell2013-01-173-3/+0
| | | |
| * | | Style cleanupPatrick Wendell2013-01-173-3/+26
| | | |
| * | | Checkpointing in Streaming java APIPatrick Wendell2013-01-173-3/+93
| | | |
| * | | Adding flatMapPatrick Wendell2013-01-172-4/+106
| | | |
| * | | Adding other updateState functionsPatrick Wendell2013-01-171-13/+49
| | | |
| * | | Bug fix and test cleanupPatrick Wendell2013-01-172-9/+12
| | | |
| * | | StashPatrick Wendell2013-01-142-1/+61
| | | |
| * | | BugfixPatrick Wendell2013-01-141-2/+4
| | | |
| * | | Remove AnyRef constraint in updateStatePatrick Wendell2013-01-142-5/+5
| | | |
| * | | Bug fixPatrick Wendell2013-01-141-2/+1
| | | |
| * | | Making comments consistent w/ Spark stylePatrick Wendell2013-01-145-232/+196
| | | |
| * | | Two changes:Patrick Wendell2013-01-142-5/+269
| | | | | | | | | | | | | | | | | | | | - Updating countByX() types based on bug fix - Porting new documentation to Java
| * | | Some style cleanupPatrick Wendell2013-01-142-53/+93
| | | |
| * | | Flume example and bug fixPatrick Wendell2013-01-141-2/+7
| | | |
| * | | More work on InputStreamsPatrick Wendell2013-01-143-10/+130
| | | |
| * | | Porting to new Duration classPatrick Wendell2013-01-145-78/+78
| | | |
| * | | Fixing issue with <Long> typesPatrick Wendell2013-01-142-10/+16
| | | |
| * | | More work on StreamingContextPatrick Wendell2013-01-141-2/+45
| | | |
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-12 17:51:47 +0000