aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
* | | | | Changed the logging level from info to warning when addJar(null) isReynold Xin2013-05-171-9/+10
| | | | | | | | | | | | | | | | | | | | called.
* | | | | Fixed a couple typos and formating problems in the YARN documentation.Reynold Xin2013-05-171-9/+11
| | | | |
* | | | | Merge branch 'master' of https://github.com/mridulm/sparkReynold Xin2013-05-171-1/+1
|\ \ \ \ \
| * | | | | Fix example jar nameMridul Muralidharan2013-05-171-1/+1
| | | | | |
* | | | | | Merge branch 'master' of github.com:mesos/sparkReynold Xin2013-05-174-3/+17
|\ \ \ \ \ \ | | |_|/ / / | |/| | | |
| * | | | | Merge pull request #615 from rxin/build-fixReynold Xin2013-05-164-3/+17
| |\ \ \ \ \ | | | | | | | | | | | | | | Maven build fix & two other small changes
| | * | | | | Only check for repl classes if the user is running the repl. Otherwise,Reynold Xin2013-05-161-2/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | check for core classes in run. This fixed the problem that core tests depend on whether repl module is compiled or not.
| | * | | | | Added dependency on netty-all in Maven.Reynold Xin2013-05-162-0/+9
| | | | | | |
| | * | | | | Removed the duplicated netty dependency in SBT build file.Reynold Xin2013-05-161-1/+0
| | | | | | |
| * | | | | | Updated Scala version in docs generation ruby script.Reynold Xin2013-05-161-1/+1
| |/ / / / /
* | / / / / Updated Scala version in docs generation ruby script.Reynold Xin2013-05-161-1/+1
| |/ / / / |/| | | |
* | | | | Hope this does not turn into a bike shed changeMridul Muralidharan2013-05-171-2/+4
| | | | |
* | | | | Fix documentation to use yarn-standalone as masterMridul Muralidharan2013-05-161-2/+2
| | | | |
* | | | | Filter out nulls - prevent NPEMridul Muralidharan2013-05-161-0/+2
| | | | |
* | | | | Fix running on yarn documentationMridul Muralidharan2013-05-161-4/+22
|/ / / /
* | | | Merge pull request #602 from rxin/shufflemergeMatei Zaharia2013-05-1525-441/+1260
|\ \ \ \ | | | | | | | | | | Manual merge & cleanup of Shane's Shuffle Performance Optimization
| * \ \ \ Merge branch 'master' of github.com:mesos/spark into shufflemergeReynold Xin2013-05-1535-208/+650
| |\ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/test/scala/spark/DistributedSuite.scala project/SparkBuild.scala
| * | | | | Added test for Netty suite.Reynold Xin2013-05-072-1/+19
| | | | | |
| * | | | | Cleaned up connection manager (moved many classes to their own files).Reynold Xin2013-05-077-252/+315
| | | | | |
| * | | | | Minor style fix in DiskStore...Reynold Xin2013-05-071-2/+2
| | | | | |
| * | | | | Cleaned up Scala files in network/netty from Shane's PR.Reynold Xin2013-05-072-33/+35
| | | | | |
| * | | | | Cleaned up the Java files from Shane's PR.Reynold Xin2013-05-078-118/+85
| | | | | |
| * | | | | Cleaned up BlockManager and BlockFetcherIterator from Shane's PR.Reynold Xin2013-05-073-99/+102
| | | | | |
| * | | | | Moved BlockFetcherIterator to its own file.Reynold Xin2013-05-072-339/+362
| | | | | |
| * | | | | Merge branch 'shuffle-performance-fix-0.7' of github.com:shane-huang/spark ↵Reynold Xin2013-05-0714-70/+811
| |\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | into shufflemerge Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/DiskStore.scala project/SparkBuild.scala
| | * | | | | fix a bug in netty Block Fetchershane-huang2013-04-163-37/+37
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: shane-huang <shengsheng.huang@intel.com>
| | * | | | | Shuffle Performance fix: Use netty embeded OIO file server instead of ↵shane-huang2013-04-0714-56/+795
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ConnectionManager Shuffle Performance Optimization: do not send 0-byte block requests to reduce network messages change reference from io.Source to scala.io.Source to avoid looking into io.netty package Signed-off-by: shane-huang <shengsheng.huang@intel.com>
* | | | | | | Merge pull request #612 from ash211/patch-4Reynold Xin2013-05-151-0/+2
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | Docs: Mention spark shell's default for MASTER
| * | | | | | | Docs: Mention spark shell's default for MASTERAndrew Ash2013-05-151-0/+2
|/ / / / / / /
* | | | | | | Merge pull request #593 from squito/driver_ui_linkReynold Xin2013-05-157-13/+21
|\ \ \ \ \ \ \ | |_|_|/ / / / |/| | | | | | Master UI has link to Application UI
| * | | | | | fix linebreakImran Rashid2013-05-091-2/+2
| | | | | | |
| * | | | | | switch from separating appUI host & port to combining into just appUiUrlImran Rashid2013-05-057-11/+8
| | | | | | |
| * | | | | | applications (aka drivers) send their webUI address to master when ↵Imran Rashid2013-05-037-13/+24
| | | | | | | | | | | | | | | | | | | | | | | | | | | | registering so it can be displayed in the master web ui
* | | | | | | Added a comment in JdbcRDD for example usage.Reynold Xin2013-05-141-1/+3
| | | | | | |
* | | | | | | Added derby dependency to Maven pom files for the JDBC Java test.Reynold Xin2013-05-142-1/+12
| | | | | | |
* | | | | | | Merge branch 'jdbc' of github.com:koeninger/sparkReynold Xin2013-05-144-1/+160
|\ \ \ \ \ \ \ | |_|_|_|_|_|/ |/| | | | | | | | | | | | | | | | | | | | Conflicts: project/SparkBuild.scala
| * | | | | | add test for JdbcRDD using embedded derby, per rxin suggestionCody Koeninger2013-05-143-0/+58
| | | | | | |
| * | | | | | code cleanup per rxin commentsCody Koeninger2013-05-111-30/+37
| | | | | | |
| * | | | | | prevent mysql driver from pulling entire resultset into memory. explicitly ↵koeninger2013-04-221-5/+20
| | | | | | | | | | | | | | | | | | | | | | | | | | | | close resultset and statement.
| * | | | | | first attempt at an RDD to pull data from JDBC sourceskoeninger2013-04-211-0/+79
| | | | | | |
* | | | | | | Merge pull request #601 from rxin/emptyrdd-masterMatei Zaharia2013-05-132-1/+37
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | EmptyRDD (master branch 0.8)
| * | | | | | | Added tests for joins, cogroups, and unions for EmptyRDD.Reynold Xin2013-05-061-0/+8
| | | | | | | |
| * | | | | | | Added EmptyRDD.Reynold Xin2013-05-062-1/+29
| | | | | | | |
| * | | | | | | Merge branch 'master' of github.com:mesos/sparkReynold Xin2013-05-0622-119/+186
| |\ \ \ \ \ \ \
| * \ \ \ \ \ \ \ Merge branch 'master' of github.com:mesos/sparkReynold Xin2013-05-0111-87/+280
| |\ \ \ \ \ \ \ \
* | \ \ \ \ \ \ \ \ Merge branch 'master' of github.com:mesos/sparkMatei Zaharia2013-05-1327-205/+437
|\ \ \ \ \ \ \ \ \ \
| * \ \ \ \ \ \ \ \ \ Merge pull request #589 from mridulm/masterMatei Zaharia2013-05-1322-193/+393
| |\ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | Add support for instance local scheduling
| | * | | | | | | | | | 1) Add support for HADOOP_CONF_DIR (and/or YARN_CONF_DIR - use either) : ↵Mridul Muralidharan2013-05-113-27/+54
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | which is used to specify the client side configuration directory : which needs to be part of the CLASSPATH. 2) Move from var+=".." to var="$var.." : the former does not work on older bash shells unfortunately.
| | * | | | | | | | | | Remove explicit hardcoding of yarn-standalone as args(0) if it is missing.Mridul Muralidharan2013-05-093-18/+3
| | | | | | | | | | | |
| | * | | | | | | | | | Merge branch 'master' of github.com:mridulm/sparkMridul Muralidharan2013-05-042-10/+38
| | |\ \ \ \ \ \ \ \ \ \