Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Update Maven docs | Matei Zaharia | 2013-08-29 | 1 | -29/+26 |
| | |||||
* | Update some build instructions because only sbt assembly and mvn package | Matei Zaharia | 2013-08-29 | 4 | -10/+10 |
| | | | | are now needed | ||||
* | Change build and run instructions to use assemblies | Matei Zaharia | 2013-08-29 | 7 | -13/+13 |
| | | | | | | | | | | | | | | | | This commit makes Spark invocation saner by using an assembly JAR to find all of Spark's dependencies instead of adding all the JARs in lib_managed. It also packages the examples into an assembly and uses that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script with two better-named scripts: "run-examples" for examples, and "spark-class" for Spark internal classes (e.g. REPL, master, etc). This is also designed to minimize the confusion people have in trying to use "run" to run their own classes; it's not meant to do that, but now at least if they look at it, they can modify run-examples to do a decent job for them. As part of this, Bagel's examples are also now properly moved to the examples package instead of bagel. | ||||
* | Merge pull request #865 from tgravescs/fixtmpdir | Matei Zaharia | 2013-08-28 | 1 | -3/+1 |
|\ | | | | | Spark on Yarn should use yarn approved directories for spark.local.dir and tmp | ||||
| * | Update docs and remove old reference to --user option | Y.CORP.YAHOO.COM\tgraves | 2013-08-26 | 1 | -3/+1 |
| | | |||||
* | | fix typos | Y.CORP.YAHOO.COM\tgraves | 2013-08-26 | 1 | -1/+1 |
| | | |||||
* | | Add ability for user to specify environment variables | Y.CORP.YAHOO.COM\tgraves | 2013-08-26 | 1 | -0/+6 |
|/ | |||||
* | Version bump for ec2 docs | Patrick Wendell | 2013-08-24 | 1 | -1/+1 |
| | |||||
* | Merge remote-tracking branch 'mesos/master' into ec2-updates | Patrick Wendell | 2013-08-24 | 6 | -29/+84 |
|\ | |||||
| * | Merge pull request #701 from ScrapCodes/documentation-suggestions | Matei Zaharia | 2013-08-22 | 2 | -3/+51 |
| |\ | | | | | | | Documentation suggestions for spark streaming. | ||||
| | * | Linking custom receiver guide | Prashant Sharma | 2013-08-23 | 1 | -0/+3 |
| | | | |||||
| | * | Improved documentation for spark custom receiver | Prashant Sharma | 2013-08-23 | 1 | -3/+48 |
| | | | |||||
| * | | Remove references to unsupported Hadoop versions | Jey Kottalam | 2013-08-21 | 1 | -1/+1 |
| | | | |||||
| * | | Update build docs | Jey Kottalam | 2013-08-21 | 2 | -24/+31 |
| | | | |||||
| * | | Update jekyll plugin to match docs/README.md | Jey Kottalam | 2013-08-21 | 1 | -1/+1 |
| | | | |||||
| * | | Update docs for Spark UI port | Matei Zaharia | 2013-08-20 | 1 | -1/+1 |
| | | | |||||
* | | | Merge branch 'master' into ec2-updates | Patrick Wendell | 2013-08-21 | 7 | -53/+90 |
|\| | | | | | | | | | | | | | | Conflicts: ec2/spark_ec2.py | ||||
| * | | Merge remote-tracking branch 'jey/hadoop-agnostic' | Matei Zaharia | 2013-08-20 | 1 | -2/+2 |
| |\ \ | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/PairRDDFunctions.scala | ||||
| | * | | update YARN docs | Jey Kottalam | 2013-08-15 | 1 | -2/+2 |
| | | | | |||||
| * | | | Address some review comments: | Matei Zaharia | 2013-08-18 | 1 | -2/+28 |
| |/ / | | | | | | | | | | | | | | | | | | | | | | | | | | | | - When a resourceOffers() call has multiple offers, force the TaskSets to consider them in increasing order of locality levels so that they get a chance to launch stuff locally across all offers - Simplify ClusterScheduler.prioritizeContainers - Add docs on the new configuration options | ||||
| * | | Merge pull request #809 from shivaram/sgd-cleanup | Evan Sparks | 2013-08-12 | 2 | -1/+2 |
| |\ \ | | | | | | | | | Clean up scaladoc in ML Lib. | ||||
| | * | | Add ML Lib scaladoc to API dropdown | Shivaram Venkataraman | 2013-08-11 | 1 | -0/+1 |
| | | | | |||||
| | * | | Clean up scaladoc in ML Lib. | Shivaram Venkataraman | 2013-08-11 | 1 | -1/+1 |
| | | | | | | | | | | | | | | | | | | | | Also build and copy ML Lib scaladoc in Spark docs build. Some more minor cleanup with respect to naming, test locations etc. | ||||
| * | | | Removing dead docs | Patrick Wendell | 2013-08-11 | 1 | -41/+0 |
| |/ / | |||||
| * | | Merge pull request #787 from ash211/master | Matei Zaharia | 2013-08-06 | 1 | -1/+1 |
| |\ \ | | | | | | | | | Update spark-standalone.md | ||||
| | * | | Update spark-standalone.md | Andrew Ash | 2013-08-07 | 1 | -1/+1 |
| | | | | |||||
| * | | | Merge remote-tracking branch 'dlyubimov/SPARK-827' | Matei Zaharia | 2013-07-31 | 1 | -0/+8 |
| |\ \ \ | | | | | | | | | | | | | | | | | | | | | Conflicts: docs/configuration.md | ||||
| | * | | | typo | Dmitriy Lyubimov | 2013-07-27 | 1 | -1/+1 |
| | | | | | |||||
| | * | | | changes per comments. | Dmitriy Lyubimov | 2013-07-27 | 1 | -0/+8 |
| | | | | | |||||
| * | | | | Documentation update for compression codec. | Reynold Xin | 2013-07-30 | 1 | -3/+18 |
| | | | | | |||||
| * | | | | Add docs about ipython | Matei Zaharia | 2013-07-29 | 1 | -3/+31 |
| | | | | | |||||
* | | | | | Merge branch 'master' into ec2-updates | Patrick Wendell | 2013-07-31 | 9 | -40/+120 |
|\| | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: ec2/deploy.generic/root/mesos-ec2/ec2-variables.sh | ||||
| * | | | | Consistently invoke bash with /usr/bin/env bash in scripts to make code more ↵ | Ubuntu | 2013-07-18 | 1 | -1/+1 |
| | | | | | | | | | | | | | | | | | | | | portable (JIRA Ticket SPARK-817) | ||||
| * | | | | Add Apache license headers and LICENSE and NOTICE files | Matei Zaharia | 2013-07-16 | 1 | -0/+17 |
| | |_|/ | |/| | | |||||
| * | | | Add an option to disable reference tracking in Kryo | Matei Zaharia | 2013-07-15 | 1 | -1/+11 |
| | | | | |||||
| * | | | Fixes typos in Spark Streaming Programming Guide | Andy Konwinski | 2013-07-12 | 1 | -2/+2 |
| | | | | | | | | | | | | These typos were reported on the spark-users mailing list, see: https://groups.google.com/d/msg/spark-users/SyLGgJlKCrI/LpeBypOkSMUJ | ||||
| * | | | Merge remote-tracking branch 'pwendell/ui-updates' | Matei Zaharia | 2013-07-06 | 1 | -2/+9 |
| |\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/scheduler/DAGScheduler.scala core/src/main/scala/spark/util/AkkaUtils.scala pom.xml | ||||
| | * | | | Adding config option for retained stages | Patrick Wendell | 2013-06-26 | 1 | -2/+9 |
| | |/ / | |||||
| * | | | Clarify that PySpark is not supported on Windows | root | 2013-07-01 | 1 | -3/+2 |
| | | | | |||||
| * | | | Update docs on SCALA_LIBRARY_PATH | Matei Zaharia | 2013-06-30 | 1 | -1/+3 |
| | | | | |||||
| * | | | Made use of spark.executor.memory setting consistent and documented it | Matei Zaharia | 2013-06-30 | 3 | -17/+25 |
| | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/SparkContext.scala | ||||
| * | | | Simplify Python docs a little to do substring search | Matei Zaharia | 2013-06-26 | 1 | -4/+3 |
| | | | | |||||
| * | | | Merge branch 'master' into streaming | Tathagata Das | 2013-06-24 | 17 | -108/+245 |
| |\ \ \ | | | | | | | | | | | | | | | | | | | | | Conflicts: .gitignore | ||||
| | * | | | ADD_JARS environment variable for spark-shell | Matei Zaharia | 2013-06-22 | 1 | -2/+8 |
| | |/ / | |||||
| | * | | Fixed a couple typos and formating problems in the YARN documentation. | Reynold Xin | 2013-05-17 | 1 | -9/+11 |
| | | | | |||||
| | * | | Merge branch 'master' of https://github.com/mridulm/spark | Reynold Xin | 2013-05-17 | 1 | -1/+1 |
| | |\ \ | |||||
| | | * | | Fix example jar name | Mridul Muralidharan | 2013-05-17 | 1 | -1/+1 |
| | | | | | |||||
| | * | | | Updated Scala version in docs generation ruby script. | Reynold Xin | 2013-05-16 | 1 | -1/+1 |
| | |/ / | |||||
| | * | | Fix documentation to use yarn-standalone as master | Mridul Muralidharan | 2013-05-16 | 1 | -2/+2 |
| | | | | |||||
| | * | | Fix running on yarn documentation | Mridul Muralidharan | 2013-05-16 | 1 | -4/+22 |
| | | | |