aboutsummaryrefslogtreecommitdiff
path: root/core
Commit message (Collapse)AuthorAgeFilesLines
* Added dependency on netty-all in Maven.Reynold Xin2013-05-161-0/+4
|
* Merge pull request #602 from rxin/shufflemergeMatei Zaharia2013-05-1523-440/+1258
|\ | | | | Manual merge & cleanup of Shane's Shuffle Performance Optimization
| * Merge branch 'master' of github.com:mesos/spark into shufflemergeReynold Xin2013-05-1528-178/+585
| |\ | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/test/scala/spark/DistributedSuite.scala project/SparkBuild.scala
| * | Added test for Netty suite.Reynold Xin2013-05-072-1/+19
| | |
| * | Cleaned up connection manager (moved many classes to their own files).Reynold Xin2013-05-077-252/+315
| | |
| * | Minor style fix in DiskStore...Reynold Xin2013-05-071-2/+2
| | |
| * | Cleaned up Scala files in network/netty from Shane's PR.Reynold Xin2013-05-072-33/+35
| | |
| * | Cleaned up the Java files from Shane's PR.Reynold Xin2013-05-078-118/+85
| | |
| * | Cleaned up BlockManager and BlockFetcherIterator from Shane's PR.Reynold Xin2013-05-073-99/+102
| | |
| * | Moved BlockFetcherIterator to its own file.Reynold Xin2013-05-072-339/+362
| | |
| * | Merge branch 'shuffle-performance-fix-0.7' of github.com:shane-huang/spark ↵Reynold Xin2013-05-0712-68/+808
| |\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | into shufflemerge Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/DiskStore.scala project/SparkBuild.scala
| | * | fix a bug in netty Block Fetchershane-huang2013-04-163-37/+37
| | | | | | | | | | | | | | | | Signed-off-by: shane-huang <shengsheng.huang@intel.com>
| | * | Shuffle Performance fix: Use netty embeded OIO file server instead of ↵shane-huang2013-04-0712-54/+792
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ConnectionManager Shuffle Performance Optimization: do not send 0-byte block requests to reduce network messages change reference from io.Source to scala.io.Source to avoid looking into io.netty package Signed-off-by: shane-huang <shengsheng.huang@intel.com>
* | | | Merge pull request #593 from squito/driver_ui_linkReynold Xin2013-05-157-13/+21
|\ \ \ \ | |_|_|/ |/| | | Master UI has link to Application UI
| * | | fix linebreakImran Rashid2013-05-091-2/+2
| | | |
| * | | switch from separating appUI host & port to combining into just appUiUrlImran Rashid2013-05-057-11/+8
| | | |
| * | | applications (aka drivers) send their webUI address to master when ↵Imran Rashid2013-05-037-13/+24
| | | | | | | | | | | | | | | | registering so it can be displayed in the master web ui
* | | | Added a comment in JdbcRDD for example usage.Reynold Xin2013-05-141-1/+3
| | | |
* | | | Added derby dependency to Maven pom files for the JDBC Java test.Reynold Xin2013-05-141-0/+5
| | | |
* | | | Merge branch 'jdbc' of github.com:koeninger/sparkReynold Xin2013-05-142-0/+157
|\ \ \ \ | | | | | | | | | | | | | | | | | | | | Conflicts: project/SparkBuild.scala
| * | | | add test for JdbcRDD using embedded derby, per rxin suggestionCody Koeninger2013-05-141-0/+56
| | | | |
| * | | | code cleanup per rxin commentsCody Koeninger2013-05-111-30/+37
| | | | |
| * | | | prevent mysql driver from pulling entire resultset into memory. explicitly ↵koeninger2013-04-221-5/+20
| | | | | | | | | | | | | | | | | | | | close resultset and statement.
| * | | | first attempt at an RDD to pull data from JDBC sourceskoeninger2013-04-211-0/+79
| | | | |
* | | | | Merge pull request #601 from rxin/emptyrdd-masterMatei Zaharia2013-05-132-1/+37
|\ \ \ \ \ | | | | | | | | | | | | EmptyRDD (master branch 0.8)
| * | | | | Added tests for joins, cogroups, and unions for EmptyRDD.Reynold Xin2013-05-061-0/+8
| | | | | |
| * | | | | Added EmptyRDD.Reynold Xin2013-05-062-1/+29
| | | | | |
* | | | | | Merge pull request #589 from mridulm/masterMatei Zaharia2013-05-1319-166/+339
|\ \ \ \ \ \ | | | | | | | | | | | | | | Add support for instance local scheduling
| * | | | | | Remove explicit hardcoding of yarn-standalone as args(0) if it is missing.Mridul Muralidharan2013-05-093-18/+3
| | | | | | |
| * | | | | | Merge branch 'master' of github.com:mridulm/sparkMridul Muralidharan2013-05-042-10/+38
| |\ \ \ \ \ \
| | * | | | | | Add support for instance local in getPreferredLocations of ↵Mridul Muralidharan2013-05-042-10/+38
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ZippedPartitionsBaseRDD. Add comments to both ZippedPartitionsBaseRDD and ZippedRDD to better describe the potential problem with the approach
| * | | | | | | Merge from masterMridul Muralidharan2013-05-0420-102/+452
| |\ \ \ \ \ \ \ | | |/ / / / / / | |/| | | | | |
| * | | | | | | pull from masterMridul Muralidharan2013-05-0417-110/+369
| |\ \ \ \ \ \ \ | | | |_|_|/ / / | | |/| | | | |
| * | | | | | | Fix ZippedRDD as part Matei's suggestionMridul Muralidharan2013-05-031-4/+15
| | | | | | | |
| * | | | | | | comment out debug versions of checkHost, etc from Utils - which were used to ↵Mridul Muralidharan2013-05-021-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | test
| * | | | | | | Integrate review comments 2Mridul Muralidharan2013-05-023-77/+77
| | | | | | | |
| * | | | | | | Integrate review comments on pull requestMridul Muralidharan2013-05-026-50/+47
| | | | | | | |
| * | | | | | | Fix some npe introduced accidentallyMridul Muralidharan2013-05-012-9/+23
| | | | | | | |
| * | | | | | | a) Add support for hyper local scheduling - specific to a host + port - ↵Mridul Muralidharan2013-05-0114-99/+244
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | before trying host local scheduling. b) Add some fixes to test code to ensure it passes (and fixes some other issues). c) Fix bug in task scheduling which incorrectly used availableCores instead of all cores on the node.
* | | | | | | | Capturing class namePatrick Wendell2013-05-124-5/+8
| | | | | | | |
* | | | | | | | Small fixPatrick Wendell2013-05-111-1/+1
| | | | | | | |
* | | | | | | | Removing importPatrick Wendell2013-05-111-1/+1
| | | | | | | |
* | | | | | | | Changing technique to use same code path in all casesPatrick Wendell2013-05-114-22/+18
| | | | | | | |
* | | | | | | | Removing unnecessary mapPatrick Wendell2013-05-111-1/+1
| | | | | | | |
* | | | | | | | SPARK-738: Spark should detect and squash nonserializable exceptionsPatrick Wendell2013-05-112-2/+35
| | | | | | | |
* | | | | | | | Actually use the cleaned closure in foreachPartitionMark Hamstra2013-05-101-1/+1
| |_|_|_|_|/ / |/| | | | | |
* | | | | | | Update Maven build to Scala 2.9.3Jey Kottalam2013-05-071-2/+2
| |_|_|/ / / |/| | | | |
* | | | | | Merge pull request #597 from JoshRosen/webui-fixesMatei Zaharia2013-05-047-13/+11
|\ \ \ \ \ \ | | | | | | | | | | | | | | Two minor bug fixes for Spark Web UI
| * | | | | | Fix SPARK-630: app details page shows finished executors as running.Josh Rosen2013-05-041-0/+1
| | | | | | |
| * | | | | | Fix wrong closing tags in web UI HTML.Josh Rosen2013-05-042-2/+2
| | | | | | |
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-08 12:58:07 +0000