Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Added back the initial spark job before starting streaming receivers | Tathagata Das | 2013-02-24 | 1 | -1/+1 |
| | |||||
* | Changed Algebird from 0.1.9 to 0.1.8 | Tathagata Das | 2013-02-24 | 2 | -2/+2 |
| | |||||
* | Merge branch 'mesos-master' into streaming | Tathagata Das | 2013-02-24 | 18 | -47/+361 |
|\ | |||||
| * | Merge pull request #468 from haitaoyao/master | Matei Zaharia | 2013-02-23 | 3 | -1/+23 |
| |\ | | | | | | | support customized java options for Master, Worker, Executor, and Repl | ||||
| | * | Merge branch 'mesos' | haitao.yao | 2013-02-21 | 3 | -7/+37 |
| | |\ | |||||
| | * \ | Merge branch 'mesos' | haitao.yao | 2013-02-20 | 4 | -2/+22 |
| | |\ \ | |||||
| | * \ \ | Merge branch 'mesos' | haitao.yao | 2013-02-19 | 88 | -749/+836 |
| | |\ \ \ | |||||
| | * | | | | support customized java options for master, worker, executor, repl shell | haitao.yao | 2013-02-16 | 1 | -0/+20 |
| | | | | | | |||||
| | * | | | | Merge branch 'mesos' | haitao.yao | 2013-02-16 | 60 | -207/+629 |
| | |\ \ \ \ | |||||
| | * \ \ \ \ | Merge branch 'mesos' | haitao.yao | 2013-02-05 | 7 | -25/+21 |
| | |\ \ \ \ \ | |||||
| | * \ \ \ \ \ | Merge branch 'mesos' | haitao.yao | 2013-02-04 | 43 | -389/+1191 |
| | |\ \ \ \ \ \ | |||||
| | * \ \ \ \ \ \ | Merge branch 'mesos' | haitao.yao | 2013-02-01 | 9 | -94/+32 |
| | |\ \ \ \ \ \ \ | |||||
| | * | | | | | | | | bug fix for javadoc | haitao.yao | 2013-01-31 | 1 | -1/+1 |
| | | | | | | | | | | |||||
| | * | | | | | | | | Merge branch 'mesos' | haitao.yao | 2013-01-31 | 7 | -23/+47 |
| | |\ \ \ \ \ \ \ \ | |||||
| | * \ \ \ \ \ \ \ \ | Merge branch 'mesos' | haitao.yao | 2013-01-30 | 2 | -7/+9 |
| | |\ \ \ \ \ \ \ \ \ | |||||
| | * \ \ \ \ \ \ \ \ \ | Merge branch 'mesos' | haitao.yao | 2013-01-30 | 56 | -408/+442 |
| | |\ \ \ \ \ \ \ \ \ \ | |||||
| | * \ \ \ \ \ \ \ \ \ \ | Merge branch 'mesos' | haitao.yao | 2013-01-29 | 42 | -423/+460 |
| | |\ \ \ \ \ \ \ \ \ \ \ | |||||
| | * \ \ \ \ \ \ \ \ \ \ \ | Merge branch 'mesos' | haitao.yao | 2013-01-28 | 45 | -314/+766 |
| | |\ \ \ \ \ \ \ \ \ \ \ \ | |||||
| | * \ \ \ \ \ \ \ \ \ \ \ \ | Merge branch 'mesos' | haitao.yao | 2013-01-24 | 246 | -2297/+17206 |
| | |\ \ \ \ \ \ \ \ \ \ \ \ \ | |||||
| | * | | | | | | | | | | | | | | add ensime | haitao.yao | 2013-01-22 | 1 | -0/+2 |
| | | | | | | | | | | | | | | | | |||||
| * | | | | | | | | | | | | | | | Merge pull request #473 from stephenh/subtract | Matei Zaharia | 2013-02-23 | 6 | -1/+218 |
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Add RDD.subtract. | ||||
| | * | | | | | | | | | | | | | | | Add subtract to JavaRDD, JavaDoubleRDD, and JavaPairRDD. | Stephen Haberman | 2013-02-24 | 3 | -1/+63 |
| | | | | | | | | | | | | | | | | | |||||
| | * | | | | | | | | | | | | | | | Update for split->partition rename. | Stephen Haberman | 2013-02-24 | 3 | -17/+17 |
| | | | | | | | | | | | | | | | | | |||||
| | * | | | | | | | | | | | | | | | Merge branch 'master' into subtract | Stephen Haberman | 2013-02-23 | 97 | -797/+1008 |
| | |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | |/ / / / / / / / / / / / / / / | |/| | | | | | | | | | | | | | | | |||||
| * | | | | | | | | | | | | | | | | Merge pull request #491 from pwendell/java-vector | Matei Zaharia | 2013-02-23 | 1 | -0/+10 |
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Adding Java-accessible methods to Vector.scala | ||||
| | * | | | | | | | | | | | | | | | | Responding to code review | Patrick Wendell | 2013-02-23 | 1 | -5/+10 |
| | | | | | | | | | | | | | | | | | | |||||
| | * | | | | | | | | | | | | | | | | Adding Java-accessible methods to Vector.scala | Patrick Wendell | 2013-02-23 | 1 | -0/+5 |
| |/ / / / / / / / / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is needed for the Strata machine learning tutorial (and also is generally helpful). | ||||
| * | | | | | | | | | | | | | | | | Handle exceptions in RecordReader.close() better (suggested by Jim | Matei Zaharia | 2013-02-23 | 2 | -9/+23 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Donahue) | ||||
| * | | | | | | | | | | | | | | | | Merge pull request #490 from woggling/conn-death | Matei Zaharia | 2013-02-22 | 2 | -4/+41 |
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Detect when SendingConnections disconnect even if we aren't sending to them | ||||
| | * | | | | | | | | | | | | | | | | Add fault tolerance test that uses replicated RDDs. | Charles Reiss | 2013-02-22 | 1 | -0/+21 |
| | | | | | | | | | | | | | | | | | | |||||
| | * | | | | | | | | | | | | | | | | Detect when SendingConnections drop by trying to read them. | Charles Reiss | 2013-02-22 | 1 | -4/+20 |
| | | |_|_|_|_|_|_|_|_|_|_|_|_|_|/ | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Comment fix | ||||
| * | | | | | | | | | | | | | | | | Several fixes to the work to log when no resources can be used by a job. | Matei Zaharia | 2013-02-22 | 2 | -8/+12 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fixed some of the messages as well as code style. | ||||
| * | | | | | | | | | | | | | | | | Merge remote-tracking branch 'pwendell/starvation-check' | Matei Zaharia | 2013-02-22 | 2 | -3/+32 |
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Also fixed a bug where master was offering executors on dead workers Conflicts: core/src/main/scala/spark/deploy/master/Master.scala | ||||
| | * | | | | | | | | | | | | | | | | Minor fixes | Patrick Wendell | 2013-02-09 | 1 | -1/+0 |
| | | | | | | | | | | | | | | | | | | |||||
| | * | | | | | | | | | | | | | | | | Changing to use Timer based on code review | Patrick Wendell | 2013-02-09 | 2 | -39/+20 |
| | | | | | | | | | | | | | | | | | | |||||
| | * | | | | | | | | | | | | | | | | Starvation check in Standlone scheduler | Patrick Wendell | 2013-02-03 | 1 | -0/+8 |
| | | | | | | | | | | | | | | | | | | |||||
| | * | | | | | | | | | | | | | | | | Starvation check in ClusterScheduler | Patrick Wendell | 2013-02-03 | 2 | -1/+41 |
| | | | | | | | | | | | | | | | | | | |||||
| * | | | | | | | | | | | | | | | | | Merge pull request #475 from JoshRosen/spark-668 | Matei Zaharia | 2013-02-22 | 2 | -26/+7 |
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Remove hack workaround for SPARK-668 | ||||
| | * | | | | | | | | | | | | | | | | | Remove hack workaround for SPARK-668. | Josh Rosen | 2013-02-11 | 2 | -26/+7 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Renaming the type paramters solves this problem (see SPARK-694). I tried this fix earlier, but it didn't work because I didn't run `sbt/sbt clean` first. | ||||
| * | | | | | | | | | | | | | | | | | | Merge pull request #489 from pwendell/SPARK-702 | Matei Zaharia | 2013-02-22 | 1 | -3/+3 |
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | |_|_|/ / / / / / / / / / / / / / / | |/| | | | | | | | | | | | | | | | | | SPARK-702: Replace Function --> JFunction in JavaAPI Suite. | ||||
| | * | | | | | | | | | | | | | | | | | SPARK-702: Replace Function --> JFunction in JavaAPI Suite. | Patrick Wendell | 2013-02-22 | 1 | -3/+3 |
| |/ / / / / / / / / / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | In a few places the Scala (rather than Java) function class is used. | ||||
| | | | * | | | | | | | | | | | | | | Add RDD.subtract. | Stephen Haberman | 2013-02-16 | 3 | -0/+155 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Instead of reusing the cogroup primitive, this adds a SubtractedRDD that knows it only needs to keep rdd1's values (per split) in memory. | ||||
* | | | | | | | | | | | | | | | | | | Fixed missing dependencies in streaming/pom.xml | Tathagata Das | 2013-02-24 | 1 | -4/+14 |
| | | | | | | | | | | | | | | | | | | |||||
* | | | | | | | | | | | | | | | | | | Fixed bugs in examples. | Tathagata Das | 2013-02-24 | 3 | -4/+3 |
| | | | | | | | | | | | | | | | | | | |||||
* | | | | | | | | | | | | | | | | | | Updated streaming programming guide with Java API info, and comments from ↵ | Tathagata Das | 2013-02-23 | 3 | -14/+76 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Patrick. | ||||
* | | | | | | | | | | | | | | | | | | Change spark.cleaner.delay to spark.cleaner.ttl. Updated docs. | Tathagata Das | 2013-02-23 | 3 | -6/+6 |
| | | | | | | | | | | | | | | | | | | |||||
* | | | | | | | | | | | | | | | | | | Fixed differences in APIs of StreamingContext and JavaStreamingContext. ↵ | Tathagata Das | 2013-02-23 | 5 | -26/+232 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Change rawNetworkStream to rawSocketStream, and added twitter, actor, zeroMQ streams to JavaStreamingContext. Also added them to JavaAPISuite. | ||||
* | | | | | | | | | | | | | | | | | | Merge branch 'mesos-streaming' into streaming | Tathagata Das | 2013-02-22 | 8 | -8/+313 |
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | |||||
| * | | | | | | | | | | | | | | | | | | Fixed resolver for akka-zeromq | Tathagata Das | 2013-02-22 | 1 | -0/+3 |
| | | | | | | | | | | | | | | | | | | | |||||
| * | | | | | | | | | | | | | | | | | | Merge pull request #480 from MLnick/streaming-eg-algebird | Tathagata Das | 2013-02-22 | 5 | -5/+179 |
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | [Streaming] Examples using Twitter's Algebird library |