aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Docs: Mention spark shell's default for MASTERAndrew Ash2013-05-151-0/+2
|
* Merge pull request #593 from squito/driver_ui_linkReynold Xin2013-05-157-13/+21
|\ | | | | Master UI has link to Application UI
| * fix linebreakImran Rashid2013-05-091-2/+2
| |
| * switch from separating appUI host & port to combining into just appUiUrlImran Rashid2013-05-057-11/+8
| |
| * applications (aka drivers) send their webUI address to master when ↵Imran Rashid2013-05-037-13/+24
| | | | | | | | registering so it can be displayed in the master web ui
* | Added a comment in JdbcRDD for example usage.Reynold Xin2013-05-141-1/+3
| |
* | Added derby dependency to Maven pom files for the JDBC Java test.Reynold Xin2013-05-142-1/+12
| |
* | Merge branch 'jdbc' of github.com:koeninger/sparkReynold Xin2013-05-144-1/+160
|\ \ | | | | | | | | | | | | Conflicts: project/SparkBuild.scala
| * | add test for JdbcRDD using embedded derby, per rxin suggestionCody Koeninger2013-05-143-0/+58
| | |
| * | code cleanup per rxin commentsCody Koeninger2013-05-111-30/+37
| | |
| * | prevent mysql driver from pulling entire resultset into memory. explicitly ↵koeninger2013-04-221-5/+20
| | | | | | | | | | | | close resultset and statement.
| * | first attempt at an RDD to pull data from JDBC sourceskoeninger2013-04-211-0/+79
| | |
* | | Merge pull request #601 from rxin/emptyrdd-masterMatei Zaharia2013-05-132-1/+37
|\ \ \ | | | | | | | | EmptyRDD (master branch 0.8)
| * | | Added tests for joins, cogroups, and unions for EmptyRDD.Reynold Xin2013-05-061-0/+8
| | | |
| * | | Added EmptyRDD.Reynold Xin2013-05-062-1/+29
| | | |
| * | | Merge branch 'master' of github.com:mesos/sparkReynold Xin2013-05-0622-119/+186
| |\ \ \
| * \ \ \ Merge branch 'master' of github.com:mesos/sparkReynold Xin2013-05-0111-87/+280
| |\ \ \ \
* | \ \ \ \ Merge branch 'master' of github.com:mesos/sparkMatei Zaharia2013-05-1327-205/+437
|\ \ \ \ \ \
| * \ \ \ \ \ Merge pull request #589 from mridulm/masterMatei Zaharia2013-05-1322-193/+393
| |\ \ \ \ \ \ | | | | | | | | | | | | | | | | Add support for instance local scheduling
| | * | | | | | 1) Add support for HADOOP_CONF_DIR (and/or YARN_CONF_DIR - use either) : ↵Mridul Muralidharan2013-05-113-27/+54
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | which is used to specify the client side configuration directory : which needs to be part of the CLASSPATH. 2) Move from var+=".." to var="$var.." : the former does not work on older bash shells unfortunately.
| | * | | | | | Remove explicit hardcoding of yarn-standalone as args(0) if it is missing.Mridul Muralidharan2013-05-093-18/+3
| | | | | | | |
| | * | | | | | Merge branch 'master' of github.com:mridulm/sparkMridul Muralidharan2013-05-042-10/+38
| | |\ \ \ \ \ \
| | | * | | | | | Add support for instance local in getPreferredLocations of ↵Mridul Muralidharan2013-05-042-10/+38
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ZippedPartitionsBaseRDD. Add comments to both ZippedPartitionsBaseRDD and ZippedRDD to better describe the potential problem with the approach
| | * | | | | | | Merge from masterMridul Muralidharan2013-05-0420-102/+452
| | |\ \ \ \ \ \ \ | | | |/ / / / / / | | |/| | | | | |
| | * | | | | | | pull from masterMridul Muralidharan2013-05-0419-131/+376
| | |\ \ \ \ \ \ \ | | | | |_|_|_|_|/ | | | |/| | | | |
| | * | | | | | | Fix ZippedRDD as part Matei's suggestionMridul Muralidharan2013-05-031-4/+15
| | | | | | | | |
| | * | | | | | | comment out debug versions of checkHost, etc from Utils - which were used to ↵Mridul Muralidharan2013-05-021-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | test
| | * | | | | | | Integrate review comments 2Mridul Muralidharan2013-05-023-77/+77
| | | | | | | | |
| | * | | | | | | Integrate review comments on pull requestMridul Muralidharan2013-05-026-50/+47
| | | | | | | | |
| | * | | | | | | Fix some npe introduced accidentallyMridul Muralidharan2013-05-012-9/+23
| | | | | | | | |
| | * | | | | | | a) Add support for hyper local scheduling - specific to a host + port - ↵Mridul Muralidharan2013-05-0114-99/+244
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | before trying host local scheduling. b) Add some fixes to test code to ensure it passes (and fixes some other issues). c) Fix bug in task scheduling which incorrectly used availableCores instead of all cores on the node.
| * | | | | | | | Merge pull request #608 from pwendell/SPARK-738Matei Zaharia2013-05-125-10/+42
| |\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | SPARK-738: Spark should detect and wrap nonserializable exceptions
| | * | | | | | | | Capturing class namePatrick Wendell2013-05-124-5/+8
| | | | | | | | | |
| | * | | | | | | | Small fixPatrick Wendell2013-05-111-1/+1
| | | | | | | | | |
| | * | | | | | | | Removing importPatrick Wendell2013-05-111-1/+1
| | | | | | | | | |
| | * | | | | | | | Changing technique to use same code path in all casesPatrick Wendell2013-05-114-22/+18
| | | | | | | | | |
| | * | | | | | | | Removing unnecessary mapPatrick Wendell2013-05-111-1/+1
| | | | | | | | | |
| | * | | | | | | | SPARK-738: Spark should detect and squash nonserializable exceptionsPatrick Wendell2013-05-112-2/+35
| |/ / / / / / / /
| * | | | | | | | Merge pull request #606 from markhamstra/foreachPartition_fixReynold Xin2013-05-101-1/+1
| |\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | Actually use the cleaned closure in foreachPartition
| | * | | | | | | | Actually use the cleaned closure in foreachPartitionMark Hamstra2013-05-101-1/+1
| |/ / / / / / / /
| * | | | | | | | Revert "Merge pull request #596 from esjewett/master" because theReynold Xin2013-05-092-40/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | dependency on hbase introduces netty-3.2.2 which conflicts with netty-3.5.3 already in Spark. This caused multiple test failures. This reverts commit 0f1b7a06e1f6782711170234f105f1b277e3b04c, reversing changes made to aacca1b8a85bd073ce185a06d6470b070761b2f4.
| * | | | | | | | Merge pull request #599 from JoshRosen/spark-670Reynold Xin2013-05-081-1/+1
| |\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | Fix SPARK-670: EC2 'start' command should require -i option.
| | * | | | | | | | Fix SPARK-670: EC2 start command should require -i option.Josh Rosen2013-05-051-1/+1
| | | |_|_|_|_|/ / | | |/| | | | | |
| * | | | | | | | Merge pull request #596 from esjewett/masterMatei Zaharia2013-05-082-1/+40
| |\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | hBase example
| | * | | | | | | | Switch to using SparkContext method to create RDDEthan Jewett2013-05-071-2/+2
| | | | | | | | | |
| | * | | | | | | | Fix indents and mention other configuration optionsEthan Jewett2013-05-041-2/+5
| | | | | | | | | |
| | * | | | | | | | Remove unnecessary column family configEthan Jewett2013-05-041-4/+2
| | | | | | | | | |
| | * | | | | | | | HBase exampleEthan Jewett2013-05-042-1/+39
| | | |_|_|/ / / / | | |/| | | | | |
* | | | | | | | | Merge branch 'master' of github.com:mesos/sparkMatei Zaharia2013-05-070-0/+0
|\| | | | | | | |
| * | | | | | | | Update Maven build to Scala 2.9.3Jey Kottalam2013-05-072-8/+7
| | |/ / / / / / | |/| | | | | |
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-23 08:27:23 +0000