| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | yarn-client addJar fix and misc other | Thomas Graves | 2014-01-09 | 1 | -2/+13 |
| | | |||||
| * | Merge pull request #345 from colorant/yarn | Thomas Graves | 2014-01-08 | 1 | -0/+2 |
| |\ | | | | | | | | | | | support distributing extra files to worker for yarn client mode So that user doesn't need to package all dependency into one assemble jar as spark app jar | ||||
| | * | Export --file for YarnClient mode to support sending extra files to worker ↵ | Raymond Liu | 2014-01-07 | 1 | -0/+2 |
| | | | | | | | | | on yarn cluster | ||||
| * | | Code review feedback | Holden Karau | 2014-01-05 | 1 | -3/+3 |
| |/ | |||||
| * | Merge remote-tracking branch 'apache-github/master' into remove-binaries | Patrick Wendell | 2014-01-03 | 1 | -7/+4 |
| |\ | | | | | | | | | | | Conflicts: core/src/test/scala/org/apache/spark/DriverSuite.scala docs/python-programming-guide.md | ||||
| | * | Merge pull request #317 from ScrapCodes/spark-915-segregate-scripts | Patrick Wendell | 2014-01-03 | 1 | -4/+4 |
| | |\ | | | | | | | | | | Spark-915 segregate scripts | ||||
| | | * | sbin/spark-class* -> bin/spark-class* | Prashant Sharma | 2014-01-03 | 1 | -2/+2 |
| | | | | |||||
| | | * | run-example -> bin/run-example | Prashant Sharma | 2014-01-02 | 1 | -1/+1 |
| | | | | |||||
| | | * | spark-shell -> bin/spark-shell | Prashant Sharma | 2014-01-02 | 1 | -1/+1 |
| | | | | |||||
| | | * | Merge branch 'scripts-reorg' of github.com:shane-huang/incubator-spark into ↵ | Prashant Sharma | 2014-01-02 | 1 | -2/+2 |
| | | |\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | spark-915-segregate-scripts Conflicts: bin/spark-shell core/pom.xml core/src/main/scala/org/apache/spark/SparkContext.scala core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala core/src/main/scala/org/apache/spark/ui/UIWorkloadGenerator.scala core/src/test/scala/org/apache/spark/DriverSuite.scala python/run-tests sbin/compute-classpath.sh sbin/spark-class sbin/stop-slaves.sh | ||||
| | | | * | added spark-class and spark-executor to sbin | shane-huang | 2013-09-23 | 1 | -2/+2 |
| | | | | | | | | | | | | | | | | | Signed-off-by: shane-huang <shengsheng.huang@intel.com> | ||||
| | * | | | fix docs for yarn | Raymond Liu | 2014-01-03 | 1 | -3/+0 |
| | | | | | |||||
| | * | | | Update maven build documentation | Raymond Liu | 2014-01-03 | 1 | -1/+1 |
| | | | | | |||||
| | * | | | Fix yarn/README.md and update docs/running-on-yarn.md | Raymond Liu | 2014-01-03 | 1 | -1/+1 |
| | |/ / | |||||
| * | | | fixed review comments | Prashant Sharma | 2014-01-03 | 1 | -2/+2 |
| | | | | |||||
| * | | | Removed sbt folder and changed docs accordingly | Prashant Sharma | 2014-01-02 | 1 | -3/+3 |
| |/ / | |||||
| * | | Fix list rendering in YARN markdown docs. | Patrick Wendell | 2013-12-10 | 1 | -5/+7 |
| | | | |||||
| * | | Various broken links in documentation | Patrick Wendell | 2013-12-07 | 1 | -2/+2 |
| | | | |||||
| * | | more docs | Ali Ghodsi | 2013-12-06 | 1 | -1/+1 |
| | | | |||||
| * | | Updated documentation about the YARN v2.2 build process | Ali Ghodsi | 2013-12-06 | 1 | -0/+8 |
| | | | |||||
| * | | Add YarnClientClusterScheduler and Backend. | Raymond Liu | 2013-11-22 | 1 | -2/+25 |
| | | | | | | | | | | | | | | | With this scheduler, the user application is launched locally, While the executor will be launched by YARN on remote nodes. This enables spark-shell to run upon YARN. | ||||
| * | | Impove Spark on Yarn Error handling | tgravescs | 2013-11-19 | 1 | -0/+2 |
| | | | |||||
| * | | Allow spark on yarn to be run from HDFS. Allows the spark.jar, app.jar, and ↵ | tgravescs | 2013-11-04 | 1 | -0/+1 |
| | | | | | | | | | log4j.properties to be put into hdfs. | ||||
| * | | Merge remote-tracking branch 'tgravescs/sparkYarnDistCache' | Matei Zaharia | 2013-10-10 | 1 | -1/+8 |
| |\ \ | | | | | | | | | | | | | | | | | | | | | | Closes #11 Conflicts: docs/running-on-yarn.md yarn/src/main/scala/org/apache/spark/deploy/yarn/ClientArguments.scala | ||||
| | * | | Adding in the --addJars option to make SparkContext.addJar work on yarn and ↵ | tgravescs | 2013-10-03 | 1 | -0/+2 |
| | | | | | | | | | | | | | | | | | | | cleanup the classpaths | ||||
| | * | | Support distributed cache files and archives on spark on yarn and attempt to ↵ | Y.CORP.YAHOO.COM\tgraves | 2013-09-23 | 1 | -1/+6 |
| | |/ | | | | | | | cleanup the staging directory on exit | ||||
| * / | Allow users to set the application name for Spark on Yarn | tgravescs | 2013-10-02 | 1 | -0/+1 |
| |/ | |||||
| * | Clarify YARN example | Jey Kottalam | 2013-09-06 | 1 | -9/+22 |
| | | |||||
| * | Review comment changes and update to org.apache packaging | Y.CORP.YAHOO.COM\tgraves | 2013-09-03 | 1 | -3/+3 |
| | | |||||
| * | Merge remote-tracking branch 'mesos/master' into yarnUILink | Y.CORP.YAHOO.COM\tgraves | 2013-09-03 | 1 | -28/+11 |
| |\ | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/ui/UIUtils.scala core/src/main/scala/org/apache/spark/ui/jobs/PoolTable.scala core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala docs/running-on-yarn.md | ||||
| | * | More doc improvements + better warnings when you haven't built Spark | Matei Zaharia | 2013-08-30 | 1 | -28/+11 |
| | | | |||||
| * | | fix up minor things | Y.CORP.YAHOO.COM\tgraves | 2013-08-30 | 1 | -1/+1 |
| | | | |||||
| * | | Link the Spark UI to the Yarn UI | Y.CORP.YAHOO.COM\tgraves | 2013-08-30 | 1 | -0/+4 |
| |/ | |||||
| * | Change build and run instructions to use assemblies | Matei Zaharia | 2013-08-29 | 1 | -4/+4 |
| | | | | | | | | | | | | | | | | | This commit makes Spark invocation saner by using an assembly JAR to find all of Spark's dependencies instead of adding all the JARs in lib_managed. It also packages the examples into an assembly and uses that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script with two better-named scripts: "run-examples" for examples, and "spark-class" for Spark internal classes (e.g. REPL, master, etc). This is also designed to minimize the confusion people have in trying to use "run" to run their own classes; it's not meant to do that, but now at least if they look at it, they can modify run-examples to do a decent job for them. As part of this, Bagel's examples are also now properly moved to the examples package instead of bagel. | ||||
| * | Merge pull request #865 from tgravescs/fixtmpdir | Matei Zaharia | 2013-08-28 | 1 | -3/+1 |
| |\ | | | | | Spark on Yarn should use yarn approved directories for spark.local.dir and tmp | ||||
| | * | Update docs and remove old reference to --user option | Y.CORP.YAHOO.COM\tgraves | 2013-08-26 | 1 | -3/+1 |
| | | | |||||
| * | | fix typos | Y.CORP.YAHOO.COM\tgraves | 2013-08-26 | 1 | -1/+1 |
| | | | |||||
| * | | Add ability for user to specify environment variables | Y.CORP.YAHOO.COM\tgraves | 2013-08-26 | 1 | -0/+6 |
| |/ | |||||
| * | Update build docs | Jey Kottalam | 2013-08-21 | 1 | -13/+7 |
| | | |||||
| * | update YARN docs | Jey Kottalam | 2013-08-15 | 1 | -2/+2 |
| | | |||||
| * | Fixed a couple typos and formating problems in the YARN documentation. | Reynold Xin | 2013-05-17 | 1 | -9/+11 |
| | | |||||
| * | Fix example jar name | Mridul Muralidharan | 2013-05-17 | 1 | -1/+1 |
| | | |||||
| * | Fix documentation to use yarn-standalone as master | Mridul Muralidharan | 2013-05-16 | 1 | -2/+2 |
| | | |||||
| * | Fix running on yarn documentation | Mridul Muralidharan | 2013-05-16 | 1 | -4/+22 |
| | | |||||
| * | 1) Add support for HADOOP_CONF_DIR (and/or YARN_CONF_DIR - use either) : ↵ | Mridul Muralidharan | 2013-05-11 | 1 | -0/+3 |
| | | | | | | | which is used to specify the client side configuration directory : which needs to be part of the CLASSPATH. 2) Move from var+=".." to var="$var.." : the former does not work on older bash shells unfortunately. | ||||
| * | Add some basic documentation | Mridul Muralidharan | 2013-04-19 | 1 | -9/+22 |
| | | |||||
| * | Fix broken link to YARN documentation. | Andy Konwinski | 2013-03-13 | 1 | -1/+1 |
| | | |||||
| * | Fixing YARN instructions | Patrick Wendell | 2012-10-09 | 1 | -3/+3 |
| | | |||||
| * | Updating lots of docs to use the new special version number variables, | Andy Konwinski | 2012-10-08 | 1 | -7/+8 |
| | | | | | | also adding the version to the navbar so it is easy to tell which version of Spark these docs were compiled for. | ||||
| * | Minor typos | Matei Zaharia | 2012-09-26 | 1 | -2/+2 |
| | | |||||
 |
index : spark | |
| Mirror of Apache Spark |
| aboutsummaryrefslogtreecommitdiff |