aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Added back the initial spark job before starting streaming receiversTathagata Das2013-02-241-1/+1
|
* Changed Algebird from 0.1.9 to 0.1.8Tathagata Das2013-02-242-2/+2
|
* Merge branch 'mesos-master' into streamingTathagata Das2013-02-2418-47/+361
|\
| * Merge pull request #468 from haitaoyao/masterMatei Zaharia2013-02-233-1/+23
| |\ | | | | | | support customized java options for Master, Worker, Executor, and Repl
| | * Merge branch 'mesos'haitao.yao2013-02-213-7/+37
| | |\
| | * \ Merge branch 'mesos'haitao.yao2013-02-204-2/+22
| | |\ \
| | * \ \ Merge branch 'mesos'haitao.yao2013-02-1988-749/+836
| | |\ \ \
| | * | | | support customized java options for master, worker, executor, repl shellhaitao.yao2013-02-161-0/+20
| | | | | |
| | * | | | Merge branch 'mesos'haitao.yao2013-02-1660-207/+629
| | |\ \ \ \
| | * \ \ \ \ Merge branch 'mesos'haitao.yao2013-02-057-25/+21
| | |\ \ \ \ \
| | * \ \ \ \ \ Merge branch 'mesos'haitao.yao2013-02-0443-389/+1191
| | |\ \ \ \ \ \
| | * \ \ \ \ \ \ Merge branch 'mesos'haitao.yao2013-02-019-94/+32
| | |\ \ \ \ \ \ \
| | * | | | | | | | bug fix for javadochaitao.yao2013-01-311-1/+1
| | | | | | | | | |
| | * | | | | | | | Merge branch 'mesos'haitao.yao2013-01-317-23/+47
| | |\ \ \ \ \ \ \ \
| | * \ \ \ \ \ \ \ \ Merge branch 'mesos'haitao.yao2013-01-302-7/+9
| | |\ \ \ \ \ \ \ \ \
| | * \ \ \ \ \ \ \ \ \ Merge branch 'mesos'haitao.yao2013-01-3056-408/+442
| | |\ \ \ \ \ \ \ \ \ \
| | * \ \ \ \ \ \ \ \ \ \ Merge branch 'mesos'haitao.yao2013-01-2942-423/+460
| | |\ \ \ \ \ \ \ \ \ \ \
| | * \ \ \ \ \ \ \ \ \ \ \ Merge branch 'mesos'haitao.yao2013-01-2845-314/+766
| | |\ \ \ \ \ \ \ \ \ \ \ \
| | * \ \ \ \ \ \ \ \ \ \ \ \ Merge branch 'mesos'haitao.yao2013-01-24246-2297/+17206
| | |\ \ \ \ \ \ \ \ \ \ \ \ \
| | * | | | | | | | | | | | | | add ensimehaitao.yao2013-01-221-0/+2
| | | | | | | | | | | | | | | |
| * | | | | | | | | | | | | | | Merge pull request #473 from stephenh/subtractMatei Zaharia2013-02-236-1/+218
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Add RDD.subtract.
| | * | | | | | | | | | | | | | | Add subtract to JavaRDD, JavaDoubleRDD, and JavaPairRDD.Stephen Haberman2013-02-243-1/+63
| | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | Update for split->partition rename.Stephen Haberman2013-02-243-17/+17
| | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | Merge branch 'master' into subtractStephen Haberman2013-02-2397-797/+1008
| | |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | |/ / / / / / / / / / / / / / / | |/| | | | | | | | | | | | | | |
| * | | | | | | | | | | | | | | | Merge pull request #491 from pwendell/java-vectorMatei Zaharia2013-02-231-0/+10
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Adding Java-accessible methods to Vector.scala
| | * | | | | | | | | | | | | | | | Responding to code reviewPatrick Wendell2013-02-231-5/+10
| | | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | | Adding Java-accessible methods to Vector.scalaPatrick Wendell2013-02-231-0/+5
| |/ / / / / / / / / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is needed for the Strata machine learning tutorial (and also is generally helpful).
| * | | | | | | | | | | | | | | | Handle exceptions in RecordReader.close() better (suggested by JimMatei Zaharia2013-02-232-9/+23
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Donahue)
| * | | | | | | | | | | | | | | | Merge pull request #490 from woggling/conn-deathMatei Zaharia2013-02-222-4/+41
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Detect when SendingConnections disconnect even if we aren't sending to them
| | * | | | | | | | | | | | | | | | Add fault tolerance test that uses replicated RDDs.Charles Reiss2013-02-221-0/+21
| | | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | | Detect when SendingConnections drop by trying to read them.Charles Reiss2013-02-221-4/+20
| | | |_|_|_|_|_|_|_|_|_|_|_|_|_|/ | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Comment fix
| * | | | | | | | | | | | | | | | Several fixes to the work to log when no resources can be used by a job.Matei Zaharia2013-02-222-8/+12
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fixed some of the messages as well as code style.
| * | | | | | | | | | | | | | | | Merge remote-tracking branch 'pwendell/starvation-check'Matei Zaharia2013-02-222-3/+32
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Also fixed a bug where master was offering executors on dead workers Conflicts: core/src/main/scala/spark/deploy/master/Master.scala
| | * | | | | | | | | | | | | | | | Minor fixesPatrick Wendell2013-02-091-1/+0
| | | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | | Changing to use Timer based on code reviewPatrick Wendell2013-02-092-39/+20
| | | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | | Starvation check in Standlone schedulerPatrick Wendell2013-02-031-0/+8
| | | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | | Starvation check in ClusterSchedulerPatrick Wendell2013-02-032-1/+41
| | | | | | | | | | | | | | | | | |
| * | | | | | | | | | | | | | | | | Merge pull request #475 from JoshRosen/spark-668Matei Zaharia2013-02-222-26/+7
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Remove hack workaround for SPARK-668
| | * | | | | | | | | | | | | | | | | Remove hack workaround for SPARK-668.Josh Rosen2013-02-112-26/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Renaming the type paramters solves this problem (see SPARK-694). I tried this fix earlier, but it didn't work because I didn't run `sbt/sbt clean` first.
| * | | | | | | | | | | | | | | | | | Merge pull request #489 from pwendell/SPARK-702Matei Zaharia2013-02-221-3/+3
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | |_|_|/ / / / / / / / / / / / / / / | |/| | | | | | | | | | | | | | | | | SPARK-702: Replace Function --> JFunction in JavaAPI Suite.
| | * | | | | | | | | | | | | | | | | SPARK-702: Replace Function --> JFunction in JavaAPI Suite.Patrick Wendell2013-02-221-3/+3
| |/ / / / / / / / / / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | In a few places the Scala (rather than Java) function class is used.
| | | | * | | | | | | | | | | | | | Add RDD.subtract.Stephen Haberman2013-02-163-0/+155
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Instead of reusing the cogroup primitive, this adds a SubtractedRDD that knows it only needs to keep rdd1's values (per split) in memory.
* | | | | | | | | | | | | | | | | | Fixed missing dependencies in streaming/pom.xmlTathagata Das2013-02-241-4/+14
| | | | | | | | | | | | | | | | | |
* | | | | | | | | | | | | | | | | | Fixed bugs in examples.Tathagata Das2013-02-243-4/+3
| | | | | | | | | | | | | | | | | |
* | | | | | | | | | | | | | | | | | Updated streaming programming guide with Java API info, and comments from ↵Tathagata Das2013-02-233-14/+76
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Patrick.
* | | | | | | | | | | | | | | | | | Change spark.cleaner.delay to spark.cleaner.ttl. Updated docs.Tathagata Das2013-02-233-6/+6
| | | | | | | | | | | | | | | | | |
* | | | | | | | | | | | | | | | | | Fixed differences in APIs of StreamingContext and JavaStreamingContext. ↵Tathagata Das2013-02-235-26/+232
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Change rawNetworkStream to rawSocketStream, and added twitter, actor, zeroMQ streams to JavaStreamingContext. Also added them to JavaAPISuite.
* | | | | | | | | | | | | | | | | | Merge branch 'mesos-streaming' into streamingTathagata Das2013-02-228-8/+313
|\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \
| * | | | | | | | | | | | | | | | | | Fixed resolver for akka-zeromqTathagata Das2013-02-221-0/+3
| | | | | | | | | | | | | | | | | | |
| * | | | | | | | | | | | | | | | | | Merge pull request #480 from MLnick/streaming-eg-algebirdTathagata Das2013-02-225-5/+179
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | [Streaming] Examples using Twitter's Algebird library