aboutsummaryrefslogtreecommitdiff
path: root/examples
Commit message (Collapse)AuthorAgeFilesLines
* Changed Algebird from 0.1.9 to 0.1.8Tathagata Das2013-02-241-1/+1
|
* Fixed bugs in examples.Tathagata Das2013-02-243-4/+3
|
* Fixed differences in APIs of StreamingContext and JavaStreamingContext. ↵Tathagata Das2013-02-231-1/+1
| | | | Change rawNetworkStream to rawSocketStream, and added twitter, actor, zeroMQ streams to JavaStreamingContext. Also added them to JavaAPISuite.
* Merge pull request #480 from MLnick/streaming-eg-algebirdTathagata Das2013-02-223-4/+167
|\ | | | | [Streaming] Examples using Twitter's Algebird library
| * Adding documentation for HLL and CMS examples. More efficient and clear use ↵Nick Pentreath2013-02-212-12/+36
| | | | | | | | of the monoids.
| * Bumping Algebird to 0.1.9Nick Pentreath2013-02-211-1/+1
| |
| * Merge remote-tracking branch 'upstream/streaming' into streaming-eg-algebirdNick Pentreath2013-02-212-1/+67
| |\
| * | Streaming example using Twitter Algebird's Count Min Sketch monoidNick Pentreath2013-02-191-0/+78
| | |
| * | Dependencies and refactoring for streaming HLL example, and using ↵Nick Pentreath2013-02-192-21/+14
| | | | | | | | | | | | context.twitterStream method
| * | Merge remote-tracking branch 'upstream/streaming' into streaming-eg-algebirdNick Pentreath2013-02-1910-108/+200
| |\ \ | | | | | | | | | | | | | | | | Conflicts: project/SparkBuild.scala
| * | | Adding streaming HyperLogLog example using AlgebirdNick Pentreath2013-02-192-0/+67
| | | |
* | | | Merge pull request #479 from ScrapCodes/zeromq-streamingTathagata Das2013-02-221-0/+73
|\ \ \ \ | |_|_|/ |/| | | Zeromq streaming
| * | | fixes corresponding to review feedback at pull request #479Prashant Sharma2013-02-201-3/+6
| | | |
| * | | example for demonstrating ZeroMQ streamPrashant Sharma2013-02-191-0/+70
| | |/ | |/|
* | | Merge branch 'mesos-streaming' into streamingTathagata Das2013-02-201-1/+1
|\ \ \ | | | | | | | | | | | | | | | | Conflicts: streaming/src/test/java/spark/streaming/JavaAPISuite.java
| * | | A bug fix post merge, following changes to AkkaUtilsPrashant Sharma2013-02-201-1/+1
| |/ /
* | | Merge branch 'mesos-master' into streamingTathagata Das2013-02-201-0/+66
|\ \ \ | |/ / |/| | | | | | | | | | | Conflicts: core/src/main/scala/spark/rdd/CheckpointRDD.scala streaming/src/main/scala/spark/streaming/dstream/ReducedWindowedDStream.scala
| * | Fixing to match Spark styleguidePatrick Wendell2013-02-051-8/+8
| | |
| * | Adding an example with an OLAP roll-upPatrick Wendell2013-02-041-0/+66
| |/
* | Added comment to the KafkaWordCount, given by Sean McNamara.Tathagata Das2013-02-191-0/+12
| |
* | Merge branch 'streaming' into ScrapCodes-streaming-actorTathagata Das2013-02-199-119/+46
|\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: docs/plugin-custom-receiver.md streaming/src/main/scala/spark/streaming/StreamingContext.scala streaming/src/main/scala/spark/streaming/dstream/KafkaInputDStream.scala streaming/src/main/scala/spark/streaming/dstream/PluggableInputDStream.scala streaming/src/main/scala/spark/streaming/receivers/ActorReceiver.scala streaming/src/test/scala/spark/streaming/InputStreamsSuite.scala
| * | Changed networkStream to socketStream and pluggableNetworkStream to become ↵Tathagata Das2013-02-184-9/+9
| | | | | | | | | | | | networkStream as a way to create streams from arbitrary network receiver.
| * | Merge branch 'streaming' into ScrapCode-streamingTathagata Das2013-02-1810-145/+64
| |\ \ | | | | | | | | | | | | | | | | | | | | Conflicts: streaming/src/main/scala/spark/streaming/dstream/KafkaInputDStream.scala streaming/src/main/scala/spark/streaming/dstream/NetworkInputDStream.scala
| | * | Moved Java streaming examples to examples/src/main/java/spark/streaming/... ↵Tathagata Das2013-02-143-0/+0
| | | | | | | | | | | | | | | | and fixed logging in NetworkInputTracker to highlight errors when receiver deregisters/shuts down.
| | * | Added TwitterInputDStream from example to StreamingContext. Renamed example ↵Tathagata Das2013-02-142-91/+13
| | | | | | | | | | | | | | | | TwitterBasic to TwitterPopularTags.
| | * | Removed countByKeyAndWindow on paired DStreams, and added ↵Tathagata Das2013-02-141-6/+5
| | | | | | | | | | | | | | | | countByValueAndWindow for all DStreams. Updated both scala and java API and testsuites.
| | * | Merge branch 'mesos-master' into streamingTathagata Das2013-02-071-11/+17
| | |\|
| | | * Remove activation of profiles by defaultMikhail Bautin2013-01-311-11/+0
| | | | | | | | | | | | | | | | | | | | See the discussion at https://github.com/mesos/spark/pull/355 for why default profile activation is a problem.
| | | * Add Maven build file for streaming, and fix some issues in SBT fileMatei Zaharia2013-01-201-0/+17
| | | | | | | | | | | | | | | | | | | | | | | | As part of this, changed our Scala 2.9.2 Kafka library to be available as a local Maven repository, following the example in (http://blog.dub.podval.org/2010/01/maven-in-project-repository.html)
| | * | Merge pull request #372 from Reinvigorate/sm-kafkaTathagata Das2013-02-071-8/+8
| | |\ \ | | | |/ | | |/| Removing offset management code that is non-existent in kafka 0.7.0+
| | | * kafkaStream API cleanup. A quorum of zookeepers can now be specifiedseanm2013-01-181-8/+8
| | | |
| * | | Plug in actor as stream receiver APIPrashant Sharma2013-01-192-0/+143
| | | |
| * | | Changed method name of createReceiver to getReceiver as it is not intended ↵Prashant Sharma2013-01-191-1/+1
| | | | | | | | | | | | | | | | to be a factory.
* | | | Taking FeederActor out as seperate programPrashant Sharma2013-02-081-22/+44
| | | |
* | | | Improved document comment in examplePrashant Sharma2013-01-251-1/+7
| | | |
* | | | actor as receiverPrashant Sharma2013-01-221-0/+130
| | | |
* | | | Changed method name of createReceiver to getReceiver as it is not intended ↵Prashant Sharma2013-01-211-1/+1
| |/ / |/| | | | | | | | to be a factory.
* | | Merge branch 'master' into streamingMatei Zaharia2013-01-201-39/+20
|\ \ \ | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/api/python/PythonRDD.scala
| * | | Minor formatting fixesMatei Zaharia2013-01-201-2/+2
| | | |
| * | | Use only one update function and pass in transpose of ratings matrix where ↵Nick Pentreath2013-01-171-29/+3
| | | | | | | | | | | | | | | | appropriate
| * | | Fixed index error missing first argumentNick Pentreath2013-01-171-1/+1
| | | |
| * | | Adding default command line args to SparkALSNick Pentreath2013-01-171-10/+17
| | | |
* | | | Merge branch 'mesos-streaming' into streamingTathagata Das2013-01-204-1/+175
|\ \ \ \ | | |/ / | |/| | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/api/java/JavaRDDLike.scala core/src/main/scala/spark/api/java/JavaSparkContext.scala core/src/test/scala/spark/JavaAPISuite.java
| * | | NetworkWordCount examplePatrick Wendell2013-01-172-1/+63
| | | |
| * | | Adding queueStream and some slight refactoringPatrick Wendell2013-01-171-0/+62
| | | |
| * | | Small doc fixPatrick Wendell2013-01-171-1/+1
| | | |
| * | | Two changes:Patrick Wendell2013-01-141-2/+2
| | | | | | | | | | | | | | | | | | | | - Updating countByX() types based on bug fix - Porting new documentation to Java
| * | | Flume example and bug fixPatrick Wendell2013-01-141-0/+50
| | |/ | |/|
* | | Merge branch 'master' into streamingTathagata Das2013-01-152-1/+12
|\ \ \ | |/ / |/| / | |/ | | | | | | | | | | Conflicts: core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala docs/_layouts/global.html docs/index.md run
| * Update examples/src/main/scala/spark/examples/LocalLR.scalaEric Zhang2013-01-131-1/+1
| | | | | | fix spelling mistake