Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
| * | | Adding some initial tests to streaming API. | Patrick Wendell | 2013-01-14 | 3 | -3/+79 | |
| | | | ||||||
| * | | A very rough, early cut at some Java functionality for Streaming. | Patrick Wendell | 2013-01-14 | 3 | -0/+188 | |
| | | | ||||||
* | | | Fixed issue https://spark-project.atlassian.net/browse/STREAMING-29, along ↵ | Tathagata Das | 2013-01-19 | 1 | -1/+7 | |
| |/ |/| | | | | | with updates to doc comments in SparkContext.checkpoint(). | |||||
* | | Fixed updateStateByKey to work with primitive types. | Tathagata Das | 2013-01-14 | 3 | -8/+8 | |
|/ | ||||||
* | Minor name fix | Tathagata Das | 2013-01-13 | 1 | -2/+2 | |
| | ||||||
* | Fixed bug | Tathagata Das | 2013-01-13 | 1 | -1/+3 | |
| | ||||||
* | Added documentation for PairDStreamFunctions. | Tathagata Das | 2013-01-13 | 3 | -27/+303 | |
| | ||||||
* | Removed stream id from the constructor of NetworkReceiver to make it easier ↵ | Tathagata Das | 2013-01-13 | 6 | -30/+68 | |
| | | | | for PluggableNetworkInputDStream. | |||||
* | Changed variable name form ***Time to ***Duration to keep things consistent. | Tathagata Das | 2013-01-09 | 26 | -186/+176 | |
| | ||||||
* | Split Time to Time (absolute instant of time) and Duration (duration of time). | Tathagata Das | 2013-01-09 | 25 | -152/+174 | |
| | ||||||
* | Moved Twitter example to the where the other examples are. | Tathagata Das | 2013-01-07 | 2 | -104/+0 | |
| | ||||||
* | Merge branch 'streaming-merge' into dev-merge | Tathagata Das | 2013-01-07 | 2 | -0/+104 | |
|\ | ||||||
| * | Merge pull request #8 from radlab/twitter-example | Patrick Wendell | 2012-12-29 | 2 | -0/+104 | |
| |\ | | | | | | | Adding a Twitter InputDStream with an example | |||||
| | * | Minor changes after review and general cleanup. | Patrick Wendell | 2012-12-21 | 2 | -11/+19 | |
| | | | | | | | | | | | | | | | | | | - Added filters to Twitter example - Removed un-used import - Some code clean-up | |||||
| | * | Adding a Twitter InputDStream with an example | Patrick Wendell | 2012-12-21 | 2 | -0/+96 | |
| | | | ||||||
* | | | Merge branch 'dev' into dev-merge | Tathagata Das | 2013-01-07 | 16 | -639/+37 | |
|\ \ \ | ||||||
| * | | | Changed locations for unit test logs. | Tathagata Das | 2013-01-07 | 1 | -2/+2 | |
| | | | | ||||||
| * | | | Fixed bug | Tathagata Das | 2013-01-07 | 1 | -1/+1 | |
| | | | | ||||||
| * | | | Renamed examples and added documentation. | Tathagata Das | 2013-01-07 | 3 | -21/+35 | |
| | | | | ||||||
| * | | | Moved Spark Streaming examples to examples sub-project. | Tathagata Das | 2013-01-06 | 12 | -616/+0 | |
| | | | | ||||||
* | | | | BufferingBlockCreator -> NetworkReceiver.BlockGenerator | Patrick Wendell | 2013-01-02 | 5 | -94/+89 | |
| | | | | ||||||
* | | | | Merge branch 'dev-merge' into datahandler-fix | Patrick Wendell | 2013-01-02 | 46 | -507/+721 | |
|\| | | | | | | | | | | | | | | | | | | | Conflicts: streaming/src/main/scala/spark/streaming/dstream/DataHandler.scala | |||||
| * | | | Updated Streaming Programming Guide. | Tathagata Das | 2013-01-01 | 1 | -0/+1 | |
| | | | | ||||||
| * | | | More classes made private[streaming] to hide from scala docs. | Tathagata Das | 2012-12-30 | 17 | -52/+135 | |
| | | | | ||||||
| * | | | Refactored a whole lot to push all DStreams into the spark.streaming.dstream ↵ | Tathagata Das | 2012-12-30 | 40 | -333/+401 | |
| | | | | | | | | | | | | | | | | package. | |||||
| * | | | Improved jekyll and scala docs. Made many classes and method private to ↵ | Tathagata Das | 2012-12-29 | 16 | -139/+201 | |
| | | | | | | | | | | | | | | | | remove them from scala docs. | |||||
* | | | | Several code-quality improvements to DataHandler. | Patrick Wendell | 2013-01-02 | 5 | -88/+84 | |
|/ / / | | | | | | | | | | | | | | | | | | | | | | - Changed to more accurate name: BufferingBlockCreator - Docstring now correctly reflects the abstraction offered by the class - Made internal methods private - Fixed indentation problems | |||||
* | | | Modifications to make sure LocalScheduler terminate cleanly without errors ↵ | Tathagata Das | 2012-12-27 | 1 | -5/+8 | |
| | | | | | | | | | | | | when SparkContext is shutdown, to minimize spurious exception during master failure tests. | |||||
* | | | Merge branch 'dev' of github.com:radlab/spark into dev-checkpoint | Tathagata Das | 2012-12-20 | 13 | -110/+683 | |
|\| | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/ParallelCollection.scala core/src/test/scala/spark/CheckpointSuite.scala streaming/src/main/scala/spark/streaming/DStream.scala | |||||
| * | | Changes in response to TD's review. | Patrick Wendell | 2012-12-07 | 6 | -15/+29 | |
| | | | ||||||
| * | | Adding Flume InputDStream | Patrick Wendell | 2012-12-07 | 8 | -6/+246 | |
| |/ | ||||||
| * | Adjust Kafka code to work with new streaming changes. | Denny | 2012-12-05 | 2 | -4/+5 | |
| | | ||||||
| * | Merge branch 'dev' into kafka | Denny | 2012-12-05 | 22 | -109/+139 | |
| |\ | | | | | | | | | | | | | Conflicts: streaming/src/main/scala/spark/streaming/DStream.scala | |||||
| * | | Added Kafka Wordcount producer | Denny | 2012-11-19 | 2 | -25/+52 | |
| | | | ||||||
| * | | Comment out code for fault-tolerance. | Denny | 2012-11-19 | 1 | -17/+18 | |
| | | | ||||||
| * | | Merge branch 'dev' into kafka | Denny | 2012-11-19 | 4 | -3/+173 | |
| |\ \ | ||||||
| * \ \ | Merge branch 'dev' into kafka | Denny | 2012-11-13 | 9 | -123/+155 | |
| |\ \ \ | | | | | | | | | | | | | | | | | | | | | Conflicts: streaming/src/main/scala/spark/streaming/DStream.scala | |||||
| * | | | | change import for example function | Denny | 2012-11-13 | 1 | -1/+1 | |
| | | | | | ||||||
| * | | | | Merge branch 'dev' into kafka | Denny | 2012-11-12 | 26 | -2055/+331 | |
| |\ \ \ \ | ||||||
| * | | | | | Updated comment. | Denny | 2012-11-11 | 1 | -1/+1 | |
| | | | | | | ||||||
| * | | | | | Add comment. | Denny | 2012-11-11 | 1 | -0/+2 | |
| | | | | | | ||||||
| * | | | | | Kafka Stream comments. | Denny | 2012-11-11 | 5 | -53/+99 | |
| | | | | | | ||||||
| * | | | | | Merge branch 'dev' of github.com:radlab/spark into kafka | Denny | 2012-11-09 | 8 | -50/+263 | |
| |\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: streaming/src/main/scala/spark/streaming/DStream.scala | |||||
| * | | | | | | Kafka Stream. | Denny | 2012-11-09 | 9 | -161/+245 | |
| | | | | | | | ||||||
| * | | | | | | Merge branch 'dev' of github.com:radlab/spark into kafka | Denny | 2012-11-06 | 16 | -237/+545 | |
| |\ \ \ \ \ \ | ||||||
| * | | | | | | | Working on kafka. | Denny | 2012-11-06 | 3 | -0/+159 | |
| | | | | | | | | ||||||
* | | | | | | | | Made checkpoint data in RDDs optional to further reduce serialized size. | Tathagata Das | 2012-12-11 | 1 | -3/+1 | |
| | | | | | | | | ||||||
* | | | | | | | | Refactored RDD checkpointing to minimize extra fields in RDD class. | Tathagata Das | 2012-12-04 | 1 | -3/+4 | |
| |_|_|_|_|_|/ |/| | | | | | | ||||||
* | | | | | | | Minor mods | Tathagata Das | 2012-12-02 | 1 | -1/+1 | |
| | | | | | | | ||||||
* | | | | | | | Made RDD checkpoint not create a new thread. Fixed bug in detecting when ↵ | Tathagata Das | 2012-12-02 | 1 | -4/+5 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | spark.cleaner.delay is insufficient. |