aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Merge branch 'master' into bettersplitsStephen Haberman2013-02-24117-879/+1755
|\ | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/RDD.scala core/src/main/scala/spark/scheduler/cluster/StandaloneSchedulerBackend.scala core/src/test/scala/spark/ShuffleSuite.scala
| * Merge pull request #468 from haitaoyao/masterMatei Zaharia2013-02-233-1/+23
| |\ | | | | | | support customized java options for Master, Worker, Executor, and Repl
| | * Merge branch 'mesos'haitao.yao2013-02-213-7/+37
| | |\
| | * \ Merge branch 'mesos'haitao.yao2013-02-204-2/+22
| | |\ \
| | * \ \ Merge branch 'mesos'haitao.yao2013-02-1988-749/+836
| | |\ \ \
| | * | | | support customized java options for master, worker, executor, repl shellhaitao.yao2013-02-161-0/+20
| | | | | |
| | * | | | Merge branch 'mesos'haitao.yao2013-02-1660-207/+629
| | |\ \ \ \
| | * \ \ \ \ Merge branch 'mesos'haitao.yao2013-02-057-25/+21
| | |\ \ \ \ \
| | * \ \ \ \ \ Merge branch 'mesos'haitao.yao2013-02-0443-389/+1191
| | |\ \ \ \ \ \
| | * \ \ \ \ \ \ Merge branch 'mesos'haitao.yao2013-02-019-94/+32
| | |\ \ \ \ \ \ \
| | * | | | | | | | bug fix for javadochaitao.yao2013-01-311-1/+1
| | | | | | | | | |
| | * | | | | | | | Merge branch 'mesos'haitao.yao2013-01-317-23/+47
| | |\ \ \ \ \ \ \ \
| | * \ \ \ \ \ \ \ \ Merge branch 'mesos'haitao.yao2013-01-302-7/+9
| | |\ \ \ \ \ \ \ \ \
| | * \ \ \ \ \ \ \ \ \ Merge branch 'mesos'haitao.yao2013-01-3056-408/+442
| | |\ \ \ \ \ \ \ \ \ \
| | * \ \ \ \ \ \ \ \ \ \ Merge branch 'mesos'haitao.yao2013-01-2942-423/+460
| | |\ \ \ \ \ \ \ \ \ \ \
| | * \ \ \ \ \ \ \ \ \ \ \ Merge branch 'mesos'haitao.yao2013-01-2845-314/+766
| | |\ \ \ \ \ \ \ \ \ \ \ \
| | * \ \ \ \ \ \ \ \ \ \ \ \ Merge branch 'mesos'haitao.yao2013-01-24246-2297/+17206
| | |\ \ \ \ \ \ \ \ \ \ \ \ \
| | * | | | | | | | | | | | | | add ensimehaitao.yao2013-01-221-0/+2
| | | | | | | | | | | | | | | |
| * | | | | | | | | | | | | | | Merge pull request #473 from stephenh/subtractMatei Zaharia2013-02-236-1/+218
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Add RDD.subtract.
| | * | | | | | | | | | | | | | | Add subtract to JavaRDD, JavaDoubleRDD, and JavaPairRDD.Stephen Haberman2013-02-243-1/+63
| | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | Update for split->partition rename.Stephen Haberman2013-02-243-17/+17
| | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | Merge branch 'master' into subtractStephen Haberman2013-02-2397-797/+1008
| | |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | |/ / / / / / / / / / / / / / / | |/| | | | | | | | | | | | | | |
| * | | | | | | | | | | | | | | | Merge pull request #491 from pwendell/java-vectorMatei Zaharia2013-02-231-0/+10
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Adding Java-accessible methods to Vector.scala
| | * | | | | | | | | | | | | | | | Responding to code reviewPatrick Wendell2013-02-231-5/+10
| | | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | | Adding Java-accessible methods to Vector.scalaPatrick Wendell2013-02-231-0/+5
| |/ / / / / / / / / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is needed for the Strata machine learning tutorial (and also is generally helpful).
| * | | | | | | | | | | | | | | | Handle exceptions in RecordReader.close() better (suggested by JimMatei Zaharia2013-02-232-9/+23
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Donahue)
| * | | | | | | | | | | | | | | | Merge pull request #490 from woggling/conn-deathMatei Zaharia2013-02-222-4/+41
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Detect when SendingConnections disconnect even if we aren't sending to them
| | * | | | | | | | | | | | | | | | Add fault tolerance test that uses replicated RDDs.Charles Reiss2013-02-221-0/+21
| | | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | | Detect when SendingConnections drop by trying to read them.Charles Reiss2013-02-221-4/+20
| | | |_|_|_|_|_|_|_|_|_|_|_|_|_|/ | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Comment fix
| * | | | | | | | | | | | | | | | Several fixes to the work to log when no resources can be used by a job.Matei Zaharia2013-02-222-8/+12
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fixed some of the messages as well as code style.
| * | | | | | | | | | | | | | | | Merge remote-tracking branch 'pwendell/starvation-check'Matei Zaharia2013-02-222-3/+32
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Also fixed a bug where master was offering executors on dead workers Conflicts: core/src/main/scala/spark/deploy/master/Master.scala
| | * | | | | | | | | | | | | | | | Minor fixesPatrick Wendell2013-02-091-1/+0
| | | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | | Changing to use Timer based on code reviewPatrick Wendell2013-02-092-39/+20
| | | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | | Starvation check in Standlone schedulerPatrick Wendell2013-02-031-0/+8
| | | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | | Starvation check in ClusterSchedulerPatrick Wendell2013-02-032-1/+41
| | | | | | | | | | | | | | | | | |
| * | | | | | | | | | | | | | | | | Merge pull request #475 from JoshRosen/spark-668Matei Zaharia2013-02-222-26/+7
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Remove hack workaround for SPARK-668
| | * | | | | | | | | | | | | | | | | Remove hack workaround for SPARK-668.Josh Rosen2013-02-112-26/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Renaming the type paramters solves this problem (see SPARK-694). I tried this fix earlier, but it didn't work because I didn't run `sbt/sbt clean` first.
| * | | | | | | | | | | | | | | | | | Merge pull request #489 from pwendell/SPARK-702Matei Zaharia2013-02-221-3/+3
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | |_|_|/ / / / / / / / / / / / / / / | |/| | | | | | | | | | | | | | | | | SPARK-702: Replace Function --> JFunction in JavaAPI Suite.
| | * | | | | | | | | | | | | | | | | SPARK-702: Replace Function --> JFunction in JavaAPI Suite.Patrick Wendell2013-02-221-3/+3
| |/ / / / / / / / / / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | In a few places the Scala (rather than Java) function class is used.
| * | | | | | | | | | | | | | | | | Merge pull request #482 from woggling/shutdown-exceptionsMatei Zaharia2013-02-193-7/+37
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | |_|_|_|_|_|_|_|_|_|_|_|_|_|_|_|/ | |/| | | | | | | | | | | | | | | | Don't call System.exit over uncaught exceptions from shutdown hooks
| | * | | | | | | | | | | | | | | | Pull detection of being in a shutdown hook into utility function.Charles Reiss2013-02-192-14/+23
| | | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | | Catch/log errors deleting temp dirsCharles Reiss2013-02-191-1/+5
| | | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | | Paranoid uncaught exception handling for exceptions during shutdownCharles Reiss2013-02-191-6/+23
| | | | | | | | | | | | | | | | | |
| * | | | | | | | | | | | | | | | | Merge pull request #484 from andyk/masterMatei Zaharia2013-02-192-1/+2
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fixes a broken link in documentation to issue tracker
| | * | | | | | | | | | | | | | | | | Fixes link to issue tracker in documentation page "Contributing to Spark".Andy Konwinski2013-02-192-1/+2
| | |/ / / / / / / / / / / / / / / /
| * | | | | | | | | | | | | | | | | Merge pull request #483 from rxin/splitpruningrdd2Matei Zaharia2013-02-191-0/+12
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | |/ / / / / / / / / / / / / / / / | |/| | | | | | | | | | | | | | | | Added a method to create PartitionPruningRDD.
| | * | | | | | | | | | | | | | | | Added a method to create PartitionPruningRDD.Reynold Xin2013-02-191-0/+12
| |/ / / / / / / / / / / / / / / /
| * | | | | | | | | | | | | | | | Merge pull request #477 from shivaram/ganglia-port-changeMatei Zaharia2013-02-181-1/+8
| |\ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ | | |_|_|_|_|_|_|_|_|_|_|_|_|_|_|/ | |/| | | | | | | | | | | | | | | Ganglia port change
| | * | | | | | | | | | | | | | | Print cluster url after setup completesShivaram Venkataraman2013-02-181-0/+5
| | | | | | | | | | | | | | | | |
| | * | | | | | | | | | | | | | | Print ganglia url after setupShivaram Venkataraman2013-02-181-0/+2
| | | | | | | | | | | | | | | | |