Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Merge remote-tracking branch 'tgravescs/sparkYarnDistCache' | Matei Zaharia | 2013-10-10 | 1 | -1/+8 |
|\ | | | | | | | | | | | | | | | Closes #11 Conflicts: docs/running-on-yarn.md yarn/src/main/scala/org/apache/spark/deploy/yarn/ClientArguments.scala | ||||
| * | Adding in the --addJars option to make SparkContext.addJar work on yarn and ↵ | tgravescs | 2013-10-03 | 1 | -0/+2 |
| | | | | | | | | | | | | cleanup the classpaths | ||||
| * | Support distributed cache files and archives on spark on yarn and attempt to ↵ | Y.CORP.YAHOO.COM\tgraves | 2013-09-23 | 1 | -1/+6 |
| | | | | | | | | cleanup the staging directory on exit | ||||
* | | Allow users to set the application name for Spark on Yarn | tgravescs | 2013-10-02 | 1 | -0/+1 |
|/ | |||||
* | Clarify YARN example | Jey Kottalam | 2013-09-06 | 1 | -9/+22 |
| | |||||
* | Review comment changes and update to org.apache packaging | Y.CORP.YAHOO.COM\tgraves | 2013-09-03 | 1 | -3/+3 |
| | |||||
* | Merge remote-tracking branch 'mesos/master' into yarnUILink | Y.CORP.YAHOO.COM\tgraves | 2013-09-03 | 1 | -28/+11 |
|\ | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/ui/UIUtils.scala core/src/main/scala/org/apache/spark/ui/jobs/PoolTable.scala core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala docs/running-on-yarn.md | ||||
| * | More doc improvements + better warnings when you haven't built Spark | Matei Zaharia | 2013-08-30 | 1 | -28/+11 |
| | | |||||
* | | fix up minor things | Y.CORP.YAHOO.COM\tgraves | 2013-08-30 | 1 | -1/+1 |
| | | |||||
* | | Link the Spark UI to the Yarn UI | Y.CORP.YAHOO.COM\tgraves | 2013-08-30 | 1 | -0/+4 |
|/ | |||||
* | Change build and run instructions to use assemblies | Matei Zaharia | 2013-08-29 | 1 | -4/+4 |
| | | | | | | | | | | | | | | | | This commit makes Spark invocation saner by using an assembly JAR to find all of Spark's dependencies instead of adding all the JARs in lib_managed. It also packages the examples into an assembly and uses that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script with two better-named scripts: "run-examples" for examples, and "spark-class" for Spark internal classes (e.g. REPL, master, etc). This is also designed to minimize the confusion people have in trying to use "run" to run their own classes; it's not meant to do that, but now at least if they look at it, they can modify run-examples to do a decent job for them. As part of this, Bagel's examples are also now properly moved to the examples package instead of bagel. | ||||
* | Merge pull request #865 from tgravescs/fixtmpdir | Matei Zaharia | 2013-08-28 | 1 | -3/+1 |
|\ | | | | | Spark on Yarn should use yarn approved directories for spark.local.dir and tmp | ||||
| * | Update docs and remove old reference to --user option | Y.CORP.YAHOO.COM\tgraves | 2013-08-26 | 1 | -3/+1 |
| | | |||||
* | | fix typos | Y.CORP.YAHOO.COM\tgraves | 2013-08-26 | 1 | -1/+1 |
| | | |||||
* | | Add ability for user to specify environment variables | Y.CORP.YAHOO.COM\tgraves | 2013-08-26 | 1 | -0/+6 |
|/ | |||||
* | Update build docs | Jey Kottalam | 2013-08-21 | 1 | -13/+7 |
| | |||||
* | update YARN docs | Jey Kottalam | 2013-08-15 | 1 | -2/+2 |
| | |||||
* | Fixed a couple typos and formating problems in the YARN documentation. | Reynold Xin | 2013-05-17 | 1 | -9/+11 |
| | |||||
* | Fix example jar name | Mridul Muralidharan | 2013-05-17 | 1 | -1/+1 |
| | |||||
* | Fix documentation to use yarn-standalone as master | Mridul Muralidharan | 2013-05-16 | 1 | -2/+2 |
| | |||||
* | Fix running on yarn documentation | Mridul Muralidharan | 2013-05-16 | 1 | -4/+22 |
| | |||||
* | 1) Add support for HADOOP_CONF_DIR (and/or YARN_CONF_DIR - use either) : ↵ | Mridul Muralidharan | 2013-05-11 | 1 | -0/+3 |
| | | | | | | which is used to specify the client side configuration directory : which needs to be part of the CLASSPATH. 2) Move from var+=".." to var="$var.." : the former does not work on older bash shells unfortunately. | ||||
* | Add some basic documentation | Mridul Muralidharan | 2013-04-19 | 1 | -9/+22 |
| | |||||
* | Fix broken link to YARN documentation. | Andy Konwinski | 2013-03-13 | 1 | -1/+1 |
| | |||||
* | Fixing YARN instructions | Patrick Wendell | 2012-10-09 | 1 | -3/+3 |
| | |||||
* | Updating lots of docs to use the new special version number variables, | Andy Konwinski | 2012-10-08 | 1 | -7/+8 |
| | | | | | also adding the version to the navbar so it is easy to tell which version of Spark these docs were compiled for. | ||||
* | Minor typos | Matei Zaharia | 2012-09-26 | 1 | -2/+2 |
| | |||||
* | Updates to standalone cluster, web UI and deploy docs. | Matei Zaharia | 2012-09-26 | 1 | -4/+12 |
| | |||||
* | Doc fixes | Matei Zaharia | 2012-09-25 | 1 | -14/+14 |
| | |||||
* | Various enhancements to the programming guide and HTML/CSS | Matei Zaharia | 2012-09-25 | 1 | -4/+4 |
| | |||||
* | Added standalone and YARN docs. Merged standalone cluster into standalone doc | Denny | 2012-09-13 | 1 | -0/+42 |