Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | Fixed differences in APIs of StreamingContext and JavaStreamingContext. ↵ | Tathagata Das | 2013-02-23 | 1 | -1/+1 | |
| | | | | Change rawNetworkStream to rawSocketStream, and added twitter, actor, zeroMQ streams to JavaStreamingContext. Also added them to JavaAPISuite. | |||||
* | Merge pull request #480 from MLnick/streaming-eg-algebird | Tathagata Das | 2013-02-22 | 3 | -4/+167 | |
|\ | | | | | [Streaming] Examples using Twitter's Algebird library | |||||
| * | Adding documentation for HLL and CMS examples. More efficient and clear use ↵ | Nick Pentreath | 2013-02-21 | 2 | -12/+36 | |
| | | | | | | | | of the monoids. | |||||
| * | Bumping Algebird to 0.1.9 | Nick Pentreath | 2013-02-21 | 1 | -1/+1 | |
| | | ||||||
| * | Merge remote-tracking branch 'upstream/streaming' into streaming-eg-algebird | Nick Pentreath | 2013-02-21 | 2 | -1/+67 | |
| |\ | ||||||
| * | | Streaming example using Twitter Algebird's Count Min Sketch monoid | Nick Pentreath | 2013-02-19 | 1 | -0/+78 | |
| | | | ||||||
| * | | Dependencies and refactoring for streaming HLL example, and using ↵ | Nick Pentreath | 2013-02-19 | 2 | -21/+14 | |
| | | | | | | | | | | | | context.twitterStream method | |||||
| * | | Merge remote-tracking branch 'upstream/streaming' into streaming-eg-algebird | Nick Pentreath | 2013-02-19 | 10 | -108/+200 | |
| |\ \ | | | | | | | | | | | | | | | | | Conflicts: project/SparkBuild.scala | |||||
| * | | | Adding streaming HyperLogLog example using Algebird | Nick Pentreath | 2013-02-19 | 2 | -0/+67 | |
| | | | | ||||||
* | | | | Merge pull request #479 from ScrapCodes/zeromq-streaming | Tathagata Das | 2013-02-22 | 1 | -0/+73 | |
|\ \ \ \ | |_|_|/ |/| | | | Zeromq streaming | |||||
| * | | | fixes corresponding to review feedback at pull request #479 | Prashant Sharma | 2013-02-20 | 1 | -3/+6 | |
| | | | | ||||||
| * | | | example for demonstrating ZeroMQ stream | Prashant Sharma | 2013-02-19 | 1 | -0/+70 | |
| | |/ | |/| | ||||||
* | | | Merge branch 'mesos-streaming' into streaming | Tathagata Das | 2013-02-20 | 1 | -1/+1 | |
|\ \ \ | | | | | | | | | | | | | | | | | Conflicts: streaming/src/test/java/spark/streaming/JavaAPISuite.java | |||||
| * | | | A bug fix post merge, following changes to AkkaUtils | Prashant Sharma | 2013-02-20 | 1 | -1/+1 | |
| |/ / | ||||||
* | | | Merge branch 'mesos-master' into streaming | Tathagata Das | 2013-02-20 | 1 | -0/+66 | |
|\ \ \ | |/ / |/| | | | | | | | | | | | Conflicts: core/src/main/scala/spark/rdd/CheckpointRDD.scala streaming/src/main/scala/spark/streaming/dstream/ReducedWindowedDStream.scala | |||||
| * | | Fixing to match Spark styleguide | Patrick Wendell | 2013-02-05 | 1 | -8/+8 | |
| | | | ||||||
| * | | Adding an example with an OLAP roll-up | Patrick Wendell | 2013-02-04 | 1 | -0/+66 | |
| |/ | ||||||
* | | Added comment to the KafkaWordCount, given by Sean McNamara. | Tathagata Das | 2013-02-19 | 1 | -0/+12 | |
| | | ||||||
* | | Merge branch 'streaming' into ScrapCodes-streaming-actor | Tathagata Das | 2013-02-19 | 9 | -119/+46 | |
|\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: docs/plugin-custom-receiver.md streaming/src/main/scala/spark/streaming/StreamingContext.scala streaming/src/main/scala/spark/streaming/dstream/KafkaInputDStream.scala streaming/src/main/scala/spark/streaming/dstream/PluggableInputDStream.scala streaming/src/main/scala/spark/streaming/receivers/ActorReceiver.scala streaming/src/test/scala/spark/streaming/InputStreamsSuite.scala | |||||
| * | | Changed networkStream to socketStream and pluggableNetworkStream to become ↵ | Tathagata Das | 2013-02-18 | 4 | -9/+9 | |
| | | | | | | | | | | | | networkStream as a way to create streams from arbitrary network receiver. | |||||
| * | | Merge branch 'streaming' into ScrapCode-streaming | Tathagata Das | 2013-02-18 | 10 | -145/+64 | |
| |\ \ | | | | | | | | | | | | | | | | | | | | | Conflicts: streaming/src/main/scala/spark/streaming/dstream/KafkaInputDStream.scala streaming/src/main/scala/spark/streaming/dstream/NetworkInputDStream.scala | |||||
| | * | | Moved Java streaming examples to examples/src/main/java/spark/streaming/... ↵ | Tathagata Das | 2013-02-14 | 3 | -0/+0 | |
| | | | | | | | | | | | | | | | | and fixed logging in NetworkInputTracker to highlight errors when receiver deregisters/shuts down. | |||||
| | * | | Added TwitterInputDStream from example to StreamingContext. Renamed example ↵ | Tathagata Das | 2013-02-14 | 2 | -91/+13 | |
| | | | | | | | | | | | | | | | | TwitterBasic to TwitterPopularTags. | |||||
| | * | | Removed countByKeyAndWindow on paired DStreams, and added ↵ | Tathagata Das | 2013-02-14 | 1 | -6/+5 | |
| | | | | | | | | | | | | | | | | countByValueAndWindow for all DStreams. Updated both scala and java API and testsuites. | |||||
| | * | | Merge branch 'mesos-master' into streaming | Tathagata Das | 2013-02-07 | 1 | -11/+17 | |
| | |\| | ||||||
| | | * | Remove activation of profiles by default | Mikhail Bautin | 2013-01-31 | 1 | -11/+0 | |
| | | | | | | | | | | | | | | | | | | | | See the discussion at https://github.com/mesos/spark/pull/355 for why default profile activation is a problem. | |||||
| | | * | Add Maven build file for streaming, and fix some issues in SBT file | Matei Zaharia | 2013-01-20 | 1 | -0/+17 | |
| | | | | | | | | | | | | | | | | | | | | | | | | As part of this, changed our Scala 2.9.2 Kafka library to be available as a local Maven repository, following the example in (http://blog.dub.podval.org/2010/01/maven-in-project-repository.html) | |||||
| | * | | Merge pull request #372 from Reinvigorate/sm-kafka | Tathagata Das | 2013-02-07 | 1 | -8/+8 | |
| | |\ \ | | | |/ | | |/| | Removing offset management code that is non-existent in kafka 0.7.0+ | |||||
| | | * | kafkaStream API cleanup. A quorum of zookeepers can now be specified | seanm | 2013-01-18 | 1 | -8/+8 | |
| | | | | ||||||
| * | | | Plug in actor as stream receiver API | Prashant Sharma | 2013-01-19 | 2 | -0/+143 | |
| | | | | ||||||
| * | | | Changed method name of createReceiver to getReceiver as it is not intended ↵ | Prashant Sharma | 2013-01-19 | 1 | -1/+1 | |
| | | | | | | | | | | | | | | | | to be a factory. | |||||
* | | | | Taking FeederActor out as seperate program | Prashant Sharma | 2013-02-08 | 1 | -22/+44 | |
| | | | | ||||||
* | | | | Improved document comment in example | Prashant Sharma | 2013-01-25 | 1 | -1/+7 | |
| | | | | ||||||
* | | | | actor as receiver | Prashant Sharma | 2013-01-22 | 1 | -0/+130 | |
| | | | | ||||||
* | | | | Changed method name of createReceiver to getReceiver as it is not intended ↵ | Prashant Sharma | 2013-01-21 | 1 | -1/+1 | |
| |/ / |/| | | | | | | | | to be a factory. | |||||
* | | | Merge branch 'master' into streaming | Matei Zaharia | 2013-01-20 | 1 | -39/+20 | |
|\ \ \ | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/api/python/PythonRDD.scala | |||||
| * | | | Minor formatting fixes | Matei Zaharia | 2013-01-20 | 1 | -2/+2 | |
| | | | | ||||||
| * | | | Use only one update function and pass in transpose of ratings matrix where ↵ | Nick Pentreath | 2013-01-17 | 1 | -29/+3 | |
| | | | | | | | | | | | | | | | | appropriate | |||||
| * | | | Fixed index error missing first argument | Nick Pentreath | 2013-01-17 | 1 | -1/+1 | |
| | | | | ||||||
| * | | | Adding default command line args to SparkALS | Nick Pentreath | 2013-01-17 | 1 | -10/+17 | |
| | | | | ||||||
* | | | | Merge branch 'mesos-streaming' into streaming | Tathagata Das | 2013-01-20 | 4 | -1/+175 | |
|\ \ \ \ | | |/ / | |/| | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/api/java/JavaRDDLike.scala core/src/main/scala/spark/api/java/JavaSparkContext.scala core/src/test/scala/spark/JavaAPISuite.java | |||||
| * | | | NetworkWordCount example | Patrick Wendell | 2013-01-17 | 2 | -1/+63 | |
| | | | | ||||||
| * | | | Adding queueStream and some slight refactoring | Patrick Wendell | 2013-01-17 | 1 | -0/+62 | |
| | | | | ||||||
| * | | | Small doc fix | Patrick Wendell | 2013-01-17 | 1 | -1/+1 | |
| | | | | ||||||
| * | | | Two changes: | Patrick Wendell | 2013-01-14 | 1 | -2/+2 | |
| | | | | | | | | | | | | | | | | | | | | - Updating countByX() types based on bug fix - Porting new documentation to Java | |||||
| * | | | Flume example and bug fix | Patrick Wendell | 2013-01-14 | 1 | -0/+50 | |
| | |/ | |/| | ||||||
* | | | Merge branch 'master' into streaming | Tathagata Das | 2013-01-15 | 2 | -1/+12 | |
|\ \ \ | |/ / |/| / | |/ | | | | | | | | | | | Conflicts: core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala docs/_layouts/global.html docs/index.md run | |||||
| * | Update examples/src/main/scala/spark/examples/LocalLR.scala | Eric Zhang | 2013-01-13 | 1 | -1/+1 | |
| | | | | | | fix spelling mistake | |||||
| * | Rename environment variable for hadoop profiles to hadoopVersion | Shivaram Venkataraman | 2013-01-12 | 1 | -2/+2 | |
| | | ||||||
| * | Activate hadoop2 profile in pom.xml with -Dhadoop=2 | Shivaram Venkataraman | 2013-01-10 | 1 | -0/+6 | |
| | |