aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Fixed differences in APIs of StreamingContext and JavaStreamingContext. ↵Tathagata Das2013-02-235-26/+232
| | | | Change rawNetworkStream to rawSocketStream, and added twitter, actor, zeroMQ streams to JavaStreamingContext. Also added them to JavaAPISuite.
* Merge branch 'mesos-streaming' into streamingTathagata Das2013-02-228-8/+313
|\
| * Fixed resolver for akka-zeromqTathagata Das2013-02-221-0/+3
| |
| * Merge pull request #480 from MLnick/streaming-eg-algebirdTathagata Das2013-02-225-5/+179
| |\ | | | | | | [Streaming] Examples using Twitter's Algebird library
| | * Adding documentation for HLL and CMS examples. More efficient and clear use ↵Nick Pentreath2013-02-212-12/+36
| | | | | | | | | | | | of the monoids.
| | * Bumping Algebird to 0.1.9Nick Pentreath2013-02-212-2/+2
| | |
| | * Merge remote-tracking branch 'upstream/streaming' into streaming-eg-algebirdNick Pentreath2013-02-21115-922/+1528
| | |\
| | * | Streaming example using Twitter Algebird's Count Min Sketch monoidNick Pentreath2013-02-191-0/+78
| | | |
| | * | Dependencies and refactoring for streaming HLL example, and using ↵Nick Pentreath2013-02-193-21/+24
| | | | | | | | | | | | | | | | context.twitterStream method
| | * | Merge remote-tracking branch 'upstream/streaming' into streaming-eg-algebirdNick Pentreath2013-02-1955-1138/+2543
| | |\ \ | | | | | | | | | | | | | | | | | | | | Conflicts: project/SparkBuild.scala
| | * | | Adding streaming HyperLogLog example using AlgebirdNick Pentreath2013-02-193-1/+69
| | | | |
| * | | | Merge pull request #479 from ScrapCodes/zeromq-streamingTathagata Das2013-02-224-3/+131
| |\ \ \ \ | | |_|_|/ | |/| | | Zeromq streaming
| | * | | removed document on zeromqPrashant Sharma2013-02-201-59/+0
| | | | |
| | * | | fixes corresponding to review feedback at pull request #479Prashant Sharma2013-02-203-6/+9
| | | | |
| | * | | example for demonstrating ZeroMQ streamPrashant Sharma2013-02-192-8/+77
| | | | |
| | * | | ZeroMQ stream as receiverPrashant Sharma2013-02-194-0/+115
| | | |/ | | |/|
| * | | Merge pull request #487 from tdas/streamingTathagata Das2013-02-20113-903/+1387
| |\ \ \ | | | | | | | | | | Merged latest master changes to streaming
* | | | | Fixed condition in InputDStream isTimeValid.Tathagata Das2013-02-211-1/+1
| |/ / / |/| | |
* | | | Merge branch 'mesos-streaming' into streamingTathagata Das2013-02-207-50/+103
|\| | | | | | | | | | | | | | | | | | | Conflicts: streaming/src/test/java/spark/streaming/JavaAPISuite.java
| * | | Merge pull request #486 from ScrapCodes/akka-example-bug-fixTathagata Das2013-02-201-1/+1
| |\ \ \ | | | | | | | | | | A bug fix to AkkaWordCount example.
| | * | | A bug fix post merge, following changes to AkkaUtilsPrashant Sharma2013-02-201-1/+1
| | |/ /
| * | | Merge pull request #481 from pwendell/stream-rdd-type-streamingTathagata Das2013-02-196-19/+146
| |\ \ \ | | |/ / | |/| | STREAMING-51: Add RDD type as a type parameter in JavaDStreamLike Edit (streaming/ version)
| | * | Small changes that were missing in mergePatrick Wendell2013-02-192-0/+2
| | | |
| | * | Use RDD type for `slice` operator in Java.Patrick Wendell2013-02-191-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | This commit uses the RDD type in `slice`, making it available to both normal and pair RDD's in java. It also updates the signature for `slice` to match changes in the Scala API.
| | * | Use RDD type for `transform` operator in Java.Patrick Wendell2013-02-192-7/+122
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is an improved implementation of the `transform` operator in Java. The main difference is that this allows all four possible types of transform functions 1. JavaRDD -> JavaRDD 2. JavaRDD -> JavaPairRDD 3. JavaPairRDD -> JavaPairRDD 4. JavaPairRDD -> JavaRDD whereas previously only (1) and (3) were possible. Conflicts: streaming/src/test/java/spark/streaming/JavaAPISuite.java
| | * | Use RDD type for `foreach` operator in Java.Patrick Wendell2013-02-196-11/+21
| |/ /
| * | Merge pull request #476 from tdas/streamingTathagata Das2013-02-1952-862/+2142
| |\ \ | | | | | | | | Major modifications to fix driver fault-tolerance with file input stream
* | | | Fixed bug in CheckpointSuiteTathagata Das2013-02-202-6/+6
| | | |
* | | | Merge branch 'mesos-master' into streamingTathagata Das2013-02-206-8/+51
|\ \ \ \
| * \ \ \ Merge pull request #482 from woggling/shutdown-exceptionsMatei Zaharia2013-02-193-7/+37
| |\ \ \ \ | | | | | | | | | | | | Don't call System.exit over uncaught exceptions from shutdown hooks
| | * | | | Pull detection of being in a shutdown hook into utility function.Charles Reiss2013-02-192-14/+23
| | | | | |
| | * | | | Catch/log errors deleting temp dirsCharles Reiss2013-02-191-1/+5
| | | | | |
| | * | | | Paranoid uncaught exception handling for exceptions during shutdownCharles Reiss2013-02-191-6/+23
| | | | | |
| * | | | | Merge pull request #484 from andyk/masterMatei Zaharia2013-02-192-1/+2
| |\ \ \ \ \ | | | | | | | | | | | | | | Fixes a broken link in documentation to issue tracker
| | * | | | | Fixes link to issue tracker in documentation page "Contributing to Spark".Andy Konwinski2013-02-192-1/+2
| | |/ / / /
| * | | | | Merge pull request #483 from rxin/splitpruningrdd2Matei Zaharia2013-02-191-0/+12
| |\ \ \ \ \ | | |/ / / / | |/| | | | Added a method to create PartitionPruningRDD.
| | * | | | Added a method to create PartitionPruningRDD.Reynold Xin2013-02-191-0/+12
| |/ / / /
* | | / / Merge branch 'mesos-master' into streamingTathagata Das2013-02-20109-893/+1408
|\| | | | | |_|/ / |/| | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/rdd/CheckpointRDD.scala streaming/src/main/scala/spark/streaming/dstream/ReducedWindowedDStream.scala
| * | | Merge pull request #477 from shivaram/ganglia-port-changeMatei Zaharia2013-02-181-1/+8
| |\ \ \ | | | | | | | | | | Ganglia port change
| | * | | Print cluster url after setup completesShivaram Venkataraman2013-02-181-0/+5
| | | | |
| | * | | Print ganglia url after setupShivaram Venkataraman2013-02-181-0/+2
| | | | |
| | * | | Use port 5080 for httpd/gangliaShivaram Venkataraman2013-02-181-1/+1
| |/ / /
| * | | Rename "jobs" to "applications" in the standalone clusterMatei Zaharia2013-02-1734-295/+299
| | | |
| * | | Renamed "splits" to "partitions"Matei Zaharia2013-02-1748-390/+405
| | | |
| * | | Clean up EC2 script options a bitMatei Zaharia2013-02-171-9/+12
| | | |
| * | | Change EC2 script to use 0.6 AMIs by default, for nowMatei Zaharia2013-02-171-5/+5
| | | |
| * | | Merge pull request #421 from shivaram/spark-ec2-changeMatei Zaharia2013-02-172-15/+59
| |\ \ \ | | | | | | | | | | Switch spark_ec2.py to use the new spark-ec2 scripts.
| | * | | Turn on ganglia by defaultShivaram Venkataraman2013-01-311-1/+1
| | | | |
| | * | | Add an option to use the old scriptsShivaram Venkataraman2013-01-281-13/+30
| | | | |
| | * | | Add option to start ganglia. Also enable Hadoop ports even if cluster type isShivaram Venkataraman2013-01-271-8/+15
| | | | | | | | | | | | | | | | | | | | not mesos
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-21 06:38:35 +0000