aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Exclude old versions of Netty from Maven-based buildJey Kottalam2013-05-182-0/+12
|
* Merge pull request #615 from rxin/build-fixReynold Xin2013-05-164-3/+17
|\ | | | | Maven build fix & two other small changes
| * Only check for repl classes if the user is running the repl. Otherwise,Reynold Xin2013-05-161-2/+8
| | | | | | | | | | check for core classes in run. This fixed the problem that core tests depend on whether repl module is compiled or not.
| * Added dependency on netty-all in Maven.Reynold Xin2013-05-162-0/+9
| |
| * Removed the duplicated netty dependency in SBT build file.Reynold Xin2013-05-161-1/+0
| |
* | Updated Scala version in docs generation ruby script.Reynold Xin2013-05-161-1/+1
|/
* Merge pull request #602 from rxin/shufflemergeMatei Zaharia2013-05-1525-441/+1260
|\ | | | | Manual merge & cleanup of Shane's Shuffle Performance Optimization
| * Merge branch 'master' of github.com:mesos/spark into shufflemergeReynold Xin2013-05-1535-208/+650
| |\ | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/test/scala/spark/DistributedSuite.scala project/SparkBuild.scala
| * | Added test for Netty suite.Reynold Xin2013-05-072-1/+19
| | |
| * | Cleaned up connection manager (moved many classes to their own files).Reynold Xin2013-05-077-252/+315
| | |
| * | Minor style fix in DiskStore...Reynold Xin2013-05-071-2/+2
| | |
| * | Cleaned up Scala files in network/netty from Shane's PR.Reynold Xin2013-05-072-33/+35
| | |
| * | Cleaned up the Java files from Shane's PR.Reynold Xin2013-05-078-118/+85
| | |
| * | Cleaned up BlockManager and BlockFetcherIterator from Shane's PR.Reynold Xin2013-05-073-99/+102
| | |
| * | Moved BlockFetcherIterator to its own file.Reynold Xin2013-05-072-339/+362
| | |
| * | Merge branch 'shuffle-performance-fix-0.7' of github.com:shane-huang/spark ↵Reynold Xin2013-05-0714-70/+811
| |\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | into shufflemerge Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/DiskStore.scala project/SparkBuild.scala
| | * | fix a bug in netty Block Fetchershane-huang2013-04-163-37/+37
| | | | | | | | | | | | | | | | Signed-off-by: shane-huang <shengsheng.huang@intel.com>
| | * | Shuffle Performance fix: Use netty embeded OIO file server instead of ↵shane-huang2013-04-0714-56/+795
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ConnectionManager Shuffle Performance Optimization: do not send 0-byte block requests to reduce network messages change reference from io.Source to scala.io.Source to avoid looking into io.netty package Signed-off-by: shane-huang <shengsheng.huang@intel.com>
* | | | Merge pull request #612 from ash211/patch-4Reynold Xin2013-05-151-0/+2
|\ \ \ \ | | | | | | | | | | Docs: Mention spark shell's default for MASTER
| * | | | Docs: Mention spark shell's default for MASTERAndrew Ash2013-05-151-0/+2
|/ / / /
* | | | Merge pull request #593 from squito/driver_ui_linkReynold Xin2013-05-157-13/+21
|\ \ \ \ | |_|_|/ |/| | | Master UI has link to Application UI
| * | | fix linebreakImran Rashid2013-05-091-2/+2
| | | |
| * | | switch from separating appUI host & port to combining into just appUiUrlImran Rashid2013-05-057-11/+8
| | | |
| * | | applications (aka drivers) send their webUI address to master when ↵Imran Rashid2013-05-037-13/+24
| | | | | | | | | | | | | | | | registering so it can be displayed in the master web ui
* | | | Added a comment in JdbcRDD for example usage.Reynold Xin2013-05-141-1/+3
| | | |
* | | | Added derby dependency to Maven pom files for the JDBC Java test.Reynold Xin2013-05-142-1/+12
| | | |
* | | | Merge branch 'jdbc' of github.com:koeninger/sparkReynold Xin2013-05-144-1/+160
|\ \ \ \ | | | | | | | | | | | | | | | | | | | | Conflicts: project/SparkBuild.scala
| * | | | add test for JdbcRDD using embedded derby, per rxin suggestionCody Koeninger2013-05-143-0/+58
| | | | |
| * | | | code cleanup per rxin commentsCody Koeninger2013-05-111-30/+37
| | | | |
| * | | | prevent mysql driver from pulling entire resultset into memory. explicitly ↵koeninger2013-04-221-5/+20
| | | | | | | | | | | | | | | | | | | | close resultset and statement.
| * | | | first attempt at an RDD to pull data from JDBC sourceskoeninger2013-04-211-0/+79
| | | | |
* | | | | Merge pull request #601 from rxin/emptyrdd-masterMatei Zaharia2013-05-132-1/+37
|\ \ \ \ \ | | | | | | | | | | | | EmptyRDD (master branch 0.8)
| * | | | | Added tests for joins, cogroups, and unions for EmptyRDD.Reynold Xin2013-05-061-0/+8
| | | | | |
| * | | | | Added EmptyRDD.Reynold Xin2013-05-062-1/+29
| | | | | |
| * | | | | Merge branch 'master' of github.com:mesos/sparkReynold Xin2013-05-0622-119/+186
| |\ \ \ \ \
| * \ \ \ \ \ Merge branch 'master' of github.com:mesos/sparkReynold Xin2013-05-0111-87/+280
| |\ \ \ \ \ \
* | \ \ \ \ \ \ Merge branch 'master' of github.com:mesos/sparkMatei Zaharia2013-05-1327-205/+437
|\ \ \ \ \ \ \ \
| * \ \ \ \ \ \ \ Merge pull request #589 from mridulm/masterMatei Zaharia2013-05-1322-193/+393
| |\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | Add support for instance local scheduling
| | * | | | | | | | 1) Add support for HADOOP_CONF_DIR (and/or YARN_CONF_DIR - use either) : ↵Mridul Muralidharan2013-05-113-27/+54
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | which is used to specify the client side configuration directory : which needs to be part of the CLASSPATH. 2) Move from var+=".." to var="$var.." : the former does not work on older bash shells unfortunately.
| | * | | | | | | | Remove explicit hardcoding of yarn-standalone as args(0) if it is missing.Mridul Muralidharan2013-05-093-18/+3
| | | | | | | | | |
| | * | | | | | | | Merge branch 'master' of github.com:mridulm/sparkMridul Muralidharan2013-05-042-10/+38
| | |\ \ \ \ \ \ \ \
| | | * | | | | | | | Add support for instance local in getPreferredLocations of ↵Mridul Muralidharan2013-05-042-10/+38
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ZippedPartitionsBaseRDD. Add comments to both ZippedPartitionsBaseRDD and ZippedRDD to better describe the potential problem with the approach
| | * | | | | | | | | Merge from masterMridul Muralidharan2013-05-0420-102/+452
| | |\ \ \ \ \ \ \ \ \ | | | |/ / / / / / / / | | |/| | | | | | | |
| | * | | | | | | | | pull from masterMridul Muralidharan2013-05-0419-131/+376
| | |\ \ \ \ \ \ \ \ \ | | | | |_|_|_|_|/ / / | | | |/| | | | | | |
| | * | | | | | | | | Fix ZippedRDD as part Matei's suggestionMridul Muralidharan2013-05-031-4/+15
| | | | | | | | | | |
| | * | | | | | | | | comment out debug versions of checkHost, etc from Utils - which were used to ↵Mridul Muralidharan2013-05-021-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | test
| | * | | | | | | | | Integrate review comments 2Mridul Muralidharan2013-05-023-77/+77
| | | | | | | | | | |
| | * | | | | | | | | Integrate review comments on pull requestMridul Muralidharan2013-05-026-50/+47
| | | | | | | | | | |
| | * | | | | | | | | Fix some npe introduced accidentallyMridul Muralidharan2013-05-012-9/+23
| | | | | | | | | | |
| | * | | | | | | | | a) Add support for hyper local scheduling - specific to a host + port - ↵Mridul Muralidharan2013-05-0114-99/+244
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | before trying host local scheduling. b) Add some fixes to test code to ensure it passes (and fixes some other issues). c) Fix bug in task scheduling which incorrectly used availableCores instead of all cores on the node.
generated by cgit v1.2.3 (git 2.39.1) at 2024-07-13 03:36:22 +0000