Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | | | | | Changed the logging level from info to warning when addJar(null) is | Reynold Xin | 2013-05-17 | 1 | -9/+10 | |
| | | | | | | | | | | | | | | | | | | | | called. | |||||
* | | | | | Fixed a couple typos and formating problems in the YARN documentation. | Reynold Xin | 2013-05-17 | 1 | -9/+11 | |
| | | | | | ||||||
* | | | | | Merge branch 'master' of https://github.com/mridulm/spark | Reynold Xin | 2013-05-17 | 1 | -1/+1 | |
|\ \ \ \ \ | ||||||
| * | | | | | Fix example jar name | Mridul Muralidharan | 2013-05-17 | 1 | -1/+1 | |
| | | | | | | ||||||
* | | | | | | Merge branch 'master' of github.com:mesos/spark | Reynold Xin | 2013-05-17 | 4 | -3/+17 | |
|\ \ \ \ \ \ | | |_|/ / / | |/| | | | | ||||||
| * | | | | | Merge pull request #615 from rxin/build-fix | Reynold Xin | 2013-05-16 | 4 | -3/+17 | |
| |\ \ \ \ \ | | | | | | | | | | | | | | | Maven build fix & two other small changes | |||||
| | * | | | | | Only check for repl classes if the user is running the repl. Otherwise, | Reynold Xin | 2013-05-16 | 1 | -2/+8 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | check for core classes in run. This fixed the problem that core tests depend on whether repl module is compiled or not. | |||||
| | * | | | | | Added dependency on netty-all in Maven. | Reynold Xin | 2013-05-16 | 2 | -0/+9 | |
| | | | | | | | ||||||
| | * | | | | | Removed the duplicated netty dependency in SBT build file. | Reynold Xin | 2013-05-16 | 1 | -1/+0 | |
| | | | | | | | ||||||
| * | | | | | | Updated Scala version in docs generation ruby script. | Reynold Xin | 2013-05-16 | 1 | -1/+1 | |
| |/ / / / / | ||||||
* | / / / / | Updated Scala version in docs generation ruby script. | Reynold Xin | 2013-05-16 | 1 | -1/+1 | |
| |/ / / / |/| | | | | ||||||
* | | | | | Hope this does not turn into a bike shed change | Mridul Muralidharan | 2013-05-17 | 1 | -2/+4 | |
| | | | | | ||||||
* | | | | | Fix documentation to use yarn-standalone as master | Mridul Muralidharan | 2013-05-16 | 1 | -2/+2 | |
| | | | | | ||||||
* | | | | | Filter out nulls - prevent NPE | Mridul Muralidharan | 2013-05-16 | 1 | -0/+2 | |
| | | | | | ||||||
* | | | | | Fix running on yarn documentation | Mridul Muralidharan | 2013-05-16 | 1 | -4/+22 | |
|/ / / / | ||||||
* | | | | Merge pull request #602 from rxin/shufflemerge | Matei Zaharia | 2013-05-15 | 25 | -441/+1260 | |
|\ \ \ \ | | | | | | | | | | | Manual merge & cleanup of Shane's Shuffle Performance Optimization | |||||
| * \ \ \ | Merge branch 'master' of github.com:mesos/spark into shufflemerge | Reynold Xin | 2013-05-15 | 35 | -208/+650 | |
| |\ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/test/scala/spark/DistributedSuite.scala project/SparkBuild.scala | |||||
| * | | | | | Added test for Netty suite. | Reynold Xin | 2013-05-07 | 2 | -1/+19 | |
| | | | | | | ||||||
| * | | | | | Cleaned up connection manager (moved many classes to their own files). | Reynold Xin | 2013-05-07 | 7 | -252/+315 | |
| | | | | | | ||||||
| * | | | | | Minor style fix in DiskStore... | Reynold Xin | 2013-05-07 | 1 | -2/+2 | |
| | | | | | | ||||||
| * | | | | | Cleaned up Scala files in network/netty from Shane's PR. | Reynold Xin | 2013-05-07 | 2 | -33/+35 | |
| | | | | | | ||||||
| * | | | | | Cleaned up the Java files from Shane's PR. | Reynold Xin | 2013-05-07 | 8 | -118/+85 | |
| | | | | | | ||||||
| * | | | | | Cleaned up BlockManager and BlockFetcherIterator from Shane's PR. | Reynold Xin | 2013-05-07 | 3 | -99/+102 | |
| | | | | | | ||||||
| * | | | | | Moved BlockFetcherIterator to its own file. | Reynold Xin | 2013-05-07 | 2 | -339/+362 | |
| | | | | | | ||||||
| * | | | | | Merge branch 'shuffle-performance-fix-0.7' of github.com:shane-huang/spark ↵ | Reynold Xin | 2013-05-07 | 14 | -70/+811 | |
| |\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | into shufflemerge Conflicts: core/src/main/scala/spark/storage/BlockManager.scala core/src/main/scala/spark/storage/DiskStore.scala project/SparkBuild.scala | |||||
| | * | | | | | fix a bug in netty Block Fetcher | shane-huang | 2013-04-16 | 3 | -37/+37 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: shane-huang <shengsheng.huang@intel.com> | |||||
| | * | | | | | Shuffle Performance fix: Use netty embeded OIO file server instead of ↵ | shane-huang | 2013-04-07 | 14 | -56/+795 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ConnectionManager Shuffle Performance Optimization: do not send 0-byte block requests to reduce network messages change reference from io.Source to scala.io.Source to avoid looking into io.netty package Signed-off-by: shane-huang <shengsheng.huang@intel.com> | |||||
* | | | | | | | Merge pull request #612 from ash211/patch-4 | Reynold Xin | 2013-05-15 | 1 | -0/+2 | |
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | Docs: Mention spark shell's default for MASTER | |||||
| * | | | | | | | Docs: Mention spark shell's default for MASTER | Andrew Ash | 2013-05-15 | 1 | -0/+2 | |
|/ / / / / / / | ||||||
* | | | | | | | Merge pull request #593 from squito/driver_ui_link | Reynold Xin | 2013-05-15 | 7 | -13/+21 | |
|\ \ \ \ \ \ \ | |_|_|/ / / / |/| | | | | | | Master UI has link to Application UI | |||||
| * | | | | | | fix linebreak | Imran Rashid | 2013-05-09 | 1 | -2/+2 | |
| | | | | | | | ||||||
| * | | | | | | switch from separating appUI host & port to combining into just appUiUrl | Imran Rashid | 2013-05-05 | 7 | -11/+8 | |
| | | | | | | | ||||||
| * | | | | | | applications (aka drivers) send their webUI address to master when ↵ | Imran Rashid | 2013-05-03 | 7 | -13/+24 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | registering so it can be displayed in the master web ui | |||||
* | | | | | | | Added a comment in JdbcRDD for example usage. | Reynold Xin | 2013-05-14 | 1 | -1/+3 | |
| | | | | | | | ||||||
* | | | | | | | Added derby dependency to Maven pom files for the JDBC Java test. | Reynold Xin | 2013-05-14 | 2 | -1/+12 | |
| | | | | | | | ||||||
* | | | | | | | Merge branch 'jdbc' of github.com:koeninger/spark | Reynold Xin | 2013-05-14 | 4 | -1/+160 | |
|\ \ \ \ \ \ \ | |_|_|_|_|_|/ |/| | | | | | | | | | | | | | | | | | | | | Conflicts: project/SparkBuild.scala | |||||
| * | | | | | | add test for JdbcRDD using embedded derby, per rxin suggestion | Cody Koeninger | 2013-05-14 | 3 | -0/+58 | |
| | | | | | | | ||||||
| * | | | | | | code cleanup per rxin comments | Cody Koeninger | 2013-05-11 | 1 | -30/+37 | |
| | | | | | | | ||||||
| * | | | | | | prevent mysql driver from pulling entire resultset into memory. explicitly ↵ | koeninger | 2013-04-22 | 1 | -5/+20 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | close resultset and statement. | |||||
| * | | | | | | first attempt at an RDD to pull data from JDBC sources | koeninger | 2013-04-21 | 1 | -0/+79 | |
| | | | | | | | ||||||
* | | | | | | | Merge pull request #601 from rxin/emptyrdd-master | Matei Zaharia | 2013-05-13 | 2 | -1/+37 | |
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | EmptyRDD (master branch 0.8) | |||||
| * | | | | | | | Added tests for joins, cogroups, and unions for EmptyRDD. | Reynold Xin | 2013-05-06 | 1 | -0/+8 | |
| | | | | | | | | ||||||
| * | | | | | | | Added EmptyRDD. | Reynold Xin | 2013-05-06 | 2 | -1/+29 | |
| | | | | | | | | ||||||
| * | | | | | | | Merge branch 'master' of github.com:mesos/spark | Reynold Xin | 2013-05-06 | 22 | -119/+186 | |
| |\ \ \ \ \ \ \ | ||||||
| * \ \ \ \ \ \ \ | Merge branch 'master' of github.com:mesos/spark | Reynold Xin | 2013-05-01 | 11 | -87/+280 | |
| |\ \ \ \ \ \ \ \ | ||||||
* | \ \ \ \ \ \ \ \ | Merge branch 'master' of github.com:mesos/spark | Matei Zaharia | 2013-05-13 | 27 | -205/+437 | |
|\ \ \ \ \ \ \ \ \ \ | ||||||
| * \ \ \ \ \ \ \ \ \ | Merge pull request #589 from mridulm/master | Matei Zaharia | 2013-05-13 | 22 | -193/+393 | |
| |\ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | Add support for instance local scheduling | |||||
| | * | | | | | | | | | | 1) Add support for HADOOP_CONF_DIR (and/or YARN_CONF_DIR - use either) : ↵ | Mridul Muralidharan | 2013-05-11 | 3 | -27/+54 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | which is used to specify the client side configuration directory : which needs to be part of the CLASSPATH. 2) Move from var+=".." to var="$var.." : the former does not work on older bash shells unfortunately. | |||||
| | * | | | | | | | | | | Remove explicit hardcoding of yarn-standalone as args(0) if it is missing. | Mridul Muralidharan | 2013-05-09 | 3 | -18/+3 | |
| | | | | | | | | | | | | ||||||
| | * | | | | | | | | | | Merge branch 'master' of github.com:mridulm/spark | Mridul Muralidharan | 2013-05-04 | 2 | -10/+38 | |
| | |\ \ \ \ \ \ \ \ \ \ |