aboutsummaryrefslogtreecommitdiff
path: root/docs/running-on-yarn.md
Commit message (Collapse)AuthorAgeFilesLines
* Clarify YARN exampleJey Kottalam2013-09-061-9/+22
|
* Review comment changes and update to org.apache packagingY.CORP.YAHOO.COM\tgraves2013-09-031-3/+3
|
* Merge remote-tracking branch 'mesos/master' into yarnUILinkY.CORP.YAHOO.COM\tgraves2013-09-031-28/+11
|\ | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/ui/UIUtils.scala core/src/main/scala/org/apache/spark/ui/jobs/PoolTable.scala core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala docs/running-on-yarn.md
| * More doc improvements + better warnings when you haven't built SparkMatei Zaharia2013-08-301-28/+11
| |
* | fix up minor thingsY.CORP.YAHOO.COM\tgraves2013-08-301-1/+1
| |
* | Link the Spark UI to the Yarn UIY.CORP.YAHOO.COM\tgraves2013-08-301-0/+4
|/
* Change build and run instructions to use assembliesMatei Zaharia2013-08-291-4/+4
| | | | | | | | | | | | | | | | This commit makes Spark invocation saner by using an assembly JAR to find all of Spark's dependencies instead of adding all the JARs in lib_managed. It also packages the examples into an assembly and uses that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script with two better-named scripts: "run-examples" for examples, and "spark-class" for Spark internal classes (e.g. REPL, master, etc). This is also designed to minimize the confusion people have in trying to use "run" to run their own classes; it's not meant to do that, but now at least if they look at it, they can modify run-examples to do a decent job for them. As part of this, Bagel's examples are also now properly moved to the examples package instead of bagel.
* Merge pull request #865 from tgravescs/fixtmpdirMatei Zaharia2013-08-281-3/+1
|\ | | | | Spark on Yarn should use yarn approved directories for spark.local.dir and tmp
| * Update docs and remove old reference to --user optionY.CORP.YAHOO.COM\tgraves2013-08-261-3/+1
| |
* | fix typosY.CORP.YAHOO.COM\tgraves2013-08-261-1/+1
| |
* | Add ability for user to specify environment variablesY.CORP.YAHOO.COM\tgraves2013-08-261-0/+6
|/
* Update build docsJey Kottalam2013-08-211-13/+7
|
* update YARN docsJey Kottalam2013-08-151-2/+2
|
* Fixed a couple typos and formating problems in the YARN documentation.Reynold Xin2013-05-171-9/+11
|
* Fix example jar nameMridul Muralidharan2013-05-171-1/+1
|
* Fix documentation to use yarn-standalone as masterMridul Muralidharan2013-05-161-2/+2
|
* Fix running on yarn documentationMridul Muralidharan2013-05-161-4/+22
|
* 1) Add support for HADOOP_CONF_DIR (and/or YARN_CONF_DIR - use either) : ↵Mridul Muralidharan2013-05-111-0/+3
| | | | | | which is used to specify the client side configuration directory : which needs to be part of the CLASSPATH. 2) Move from var+=".." to var="$var.." : the former does not work on older bash shells unfortunately.
* Add some basic documentationMridul Muralidharan2013-04-191-9/+22
|
* Fix broken link to YARN documentation.Andy Konwinski2013-03-131-1/+1
|
* Fixing YARN instructionsPatrick Wendell2012-10-091-3/+3
|
* Updating lots of docs to use the new special version number variables,Andy Konwinski2012-10-081-7/+8
| | | | | also adding the version to the navbar so it is easy to tell which version of Spark these docs were compiled for.
* Minor typosMatei Zaharia2012-09-261-2/+2
|
* Updates to standalone cluster, web UI and deploy docs.Matei Zaharia2012-09-261-4/+12
|
* Doc fixesMatei Zaharia2012-09-251-14/+14
|
* Various enhancements to the programming guide and HTML/CSSMatei Zaharia2012-09-251-4/+4
|
* Added standalone and YARN docs. Merged standalone cluster into standalone docDenny2012-09-131-0/+42