aboutsummaryrefslogtreecommitdiff
path: root/streaming
Commit message (Collapse)AuthorAgeFilesLines
* STREAMING-50: Support transform workaround in JavaPairDStreamPatrick Wendell2013-02-122-2/+77
| | | | | | This ports a useful workaround (the `transform` function) to JavaPairDStream. It is necessary to do things like sorting which are not supported yet in the core streaming API.
* Using tuple swap()Patrick Wendell2013-02-111-2/+2
|
* small fixPatrick Wendell2013-02-111-2/+2
|
* Fix for MapPartitionsPatrick Wendell2013-02-112-17/+54
|
* Fix for flatmapPatrick Wendell2013-02-112-2/+44
|
* Indentation fixPatrick Wendell2013-02-111-10/+10
|
* Initial cut at replacing K, V in Java filesPatrick Wendell2013-02-112-2/+58
|
* Streaming constructor which takes JavaSparkContextPatrick Wendell2013-02-051-0/+8
| | | | | It's sometimes helpful to directly pass a JavaSparkContext, and take advantage of the various constructors available for that.
* Remove activation of profiles by defaultMikhail Bautin2013-01-311-11/+0
| | | | | See the discussion at https://github.com/mesos/spark/pull/355 for why default profile activation is a problem.
* Merge pull request #415 from stephenh/driverMatei Zaharia2013-01-297-8/+8
|\ | | | | Replace old 'master' term with 'driver'.
| * Replace old 'master' term with 'driver'.Stephen Haberman2013-01-257-8/+8
| |
* | Fix code that depended on metadata cleaner interval being in minutesMatei Zaharia2013-01-282-5/+5
|/
* Refactor daemon thread pool creation.Josh Rosen2013-01-211-2/+3
|
* Move JavaAPISuite into spark.streaming.Stephen Haberman2013-01-212-0/+0
|
* Add Maven build file for streaming, and fix some issues in SBT fileMatei Zaharia2013-01-2010-0/+182
| | | | | | As part of this, changed our Scala 2.9.2 Kafka library to be available as a local Maven repository, following the example in (http://blog.dub.podval.org/2010/01/maven-in-project-repository.html)
* Fixed streaming testsuite bugsTathagata Das2013-01-207-6/+24
|
* Merge branch 'mesos-streaming' into streamingTathagata Das2013-01-208-120/+2452
|\ | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/api/java/JavaRDDLike.scala core/src/main/scala/spark/api/java/JavaSparkContext.scala core/src/test/scala/spark/JavaAPISuite.java
| * Moving tests to appropriate directoryPatrick Wendell2013-01-172-0/+0
| |
| * Adding queueStream and some slight refactoringPatrick Wendell2013-01-172-81/+163
| |
| * Merge branch 'streaming' into streaming-java-apiPatrick Wendell2013-01-171-3/+3
| |\
| * | Import fixupPatrick Wendell2013-01-173-3/+0
| | |
| * | Style cleanupPatrick Wendell2013-01-173-3/+26
| | |
| * | Checkpointing in Streaming java APIPatrick Wendell2013-01-173-3/+93
| | |
| * | Adding flatMapPatrick Wendell2013-01-172-4/+106
| | |
| * | Adding other updateState functionsPatrick Wendell2013-01-171-13/+49
| | |
| * | Bug fix and test cleanupPatrick Wendell2013-01-172-9/+12
| | |
| * | StashPatrick Wendell2013-01-142-1/+61
| | |
| * | BugfixPatrick Wendell2013-01-141-2/+4
| | |
| * | Remove AnyRef constraint in updateStatePatrick Wendell2013-01-142-5/+5
| | |
| * | Bug fixPatrick Wendell2013-01-141-2/+1
| | |
| * | Making comments consistent w/ Spark stylePatrick Wendell2013-01-145-232/+196
| | |
| * | Two changes:Patrick Wendell2013-01-142-5/+269
| | | | | | | | | | | | | | | - Updating countByX() types based on bug fix - Porting new documentation to Java
| * | Some style cleanupPatrick Wendell2013-01-142-53/+93
| | |
| * | Flume example and bug fixPatrick Wendell2013-01-141-2/+7
| | |
| * | More work on InputStreamsPatrick Wendell2013-01-143-10/+130
| | |
| * | Porting to new Duration classPatrick Wendell2013-01-145-78/+78
| | |
| * | Fixing issue with <Long> typesPatrick Wendell2013-01-142-10/+16
| | |
| * | More work on StreamingContextPatrick Wendell2013-01-141-2/+45
| | |
| * | Import CleanupPatrick Wendell2013-01-143-4/+3
| | |
| * | Some docs for the JavaTestUtilsPatrick Wendell2013-01-141-6/+22
| | |
| * | Docs, some tests, and work onPatrick Wendell2013-01-145-32/+617
| | | | | | | | | | | | StreamingContext
| * | Squashing a few TODOsPatrick Wendell2013-01-141-4/+15
| | |
| * | Style cleanup and moving functionsPatrick Wendell2013-01-143-67/+128
| | |
| * | More pair functionsPatrick Wendell2013-01-141-1/+42
| | |
| * | PairDStream and DStreamLikePatrick Wendell2013-01-145-100/+359
| | |
| * | Adding transform and unionPatrick Wendell2013-01-142-4/+72
| | |
| * | Reduce testsPatrick Wendell2013-01-141-6/+63
| | |
| * | Adding more testsPatrick Wendell2013-01-142-10/+173
| | |
| * | Better equality test (thanks Josh)Patrick Wendell2013-01-141-4/+3
| | |
| * | Remving main method from testsPatrick Wendell2013-01-141-27/+0
| | |
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-12 21:01:46 +0000