aboutsummaryrefslogtreecommitdiff
path: root/README.md
Commit message (Collapse)AuthorAgeFilesLines
* [SPARK-1876] Windows fixes to deal with latest distribution layout changesMatei Zaharia2014-05-191-3/+4
| | | | | | | | | | | | | | | | | | | | - Look for JARs in the right place - Launch examples the same way as on Unix - Load datanucleus JARs if they exist - Don't attempt to parse local paths as URIs in SparkSubmit, since paths with C:\ are not valid URIs - Also fixed POM exclusion rules for datanucleus (it wasn't properly excluding it, whereas SBT was) Author: Matei Zaharia <matei@databricks.com> Closes #819 from mateiz/win-fixes and squashes the following commits: d558f96 [Matei Zaharia] Fix comment 228577b [Matei Zaharia] Review comments d3b71c7 [Matei Zaharia] Properly exclude datanucleus files in Maven assembly 144af84 [Matei Zaharia] Update Windows scripts to match latest binary package layout (cherry picked from commit 7b70a7071894dd90ea1d0091542b3e13e7ef8d3a) Signed-off-by: Tathagata Das <tathagata.das1565@gmail.com>
* SPARK-1565 (Addendum): Replace `run-example` with `spark-submit`.Patrick Wendell2014-05-081-7/+12
| | | | | | | | | | | | | | | | Gives a nicely formatted message to the user when `run-example` is run to tell them to use `spark-submit`. Author: Patrick Wendell <pwendell@gmail.com> Closes #704 from pwendell/examples and squashes the following commits: 1996ee8 [Patrick Wendell] Feedback form Andrew 3eb7803 [Patrick Wendell] Suggestions from TD 2474668 [Patrick Wendell] SPARK-1565 (Addendum): Replace `run-example` with `spark-submit`. (cherry picked from commit 06b15baab25951d124bbe6b64906f4139e037deb) Signed-off-by: Patrick Wendell <pwendell@gmail.com>
* README updateReynold Xin2014-04-181-11/+24
| | | | | | | | | | | | Author: Reynold Xin <rxin@apache.org> Closes #443 from rxin/readme and squashes the following commits: 16853de [Reynold Xin] Updated SBT and Scala instructions. 3ac3ceb [Reynold Xin] README update (cherry picked from commit 28238c81d9d81dba5d880cbd7ee910ec326bdc79) Signed-off-by: Reynold Xin <rxin@apache.org>
* Removed reference to incubation in README.md.Reynold Xin2014-02-261-14/+3
| | | | | | | | Author: Reynold Xin <rxin@apache.org> Closes #1 from rxin/readme and squashes the following commits: b3a77cd [Reynold Xin] Removed reference to incubation in README.md.
* Update README.mdPrashant Sharma2014-01-081-1/+1
| | | The link does not work otherwise.
* Code review feedbackHolden Karau2014-01-051-6/+8
|
* And update docs to matchHolden Karau2014-01-041-2/+2
|
* Switch from sbt to ./sbt in the README fileHolden Karau2014-01-041-2/+2
|
* Merge remote-tracking branch 'apache-github/master' into remove-binariesPatrick Wendell2014-01-031-4/+4
|\ | | | | | | | | | | Conflicts: core/src/test/scala/org/apache/spark/DriverSuite.scala docs/python-programming-guide.md
| * pyspark -> bin/pysparkPrashant Sharma2014-01-021-1/+1
| |
| * run-example -> bin/run-examplePrashant Sharma2014-01-021-2/+2
| |
| * spark-shell -> bin/spark-shellPrashant Sharma2014-01-021-1/+1
| |
* | Changes on top of Prashant's patch.Patrick Wendell2014-01-031-16/+3
| | | | | | | | Closes #316
* | fixed review commentsPrashant Sharma2014-01-031-8/+11
| |
* | Removed sbt folder and changed docs accordinglyPrashant Sharma2014-01-021-7/+23
|/
* Attempt with extra repositoriesPatrick Wendell2013-12-161-4/+2
|
* Merge branch 'master' into akka-bug-fixPrashant Sharma2013-12-111-3/+5
|\ | | | | | | | | | | | | | | | | | | Conflicts: core/pom.xml core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala pom.xml project/SparkBuild.scala streaming/pom.xml yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocationHandler.scala
| * README incorrectly suggests build sources spark-env.shPatrick Wendell2013-12-101-3/+0
| | | | | | | | | | | | This is misleading because the build doesn't source that file. IMO it's better to force people to specify build environment variables on the command line always, like we do in every example.
| * Minor doc fixes and updating READMEPatrick Wendell2013-12-061-1/+6
| |
* | Merge branch 'master' into scala-2.10Raymond Liu2013-11-131-1/+1
|\|
| * Fixed a typo in Hadoop version in README.Reynold Xin2013-11-021-1/+1
| |
* | Merge branch 'master' into scala-2.10Prashant Sharma2013-10-011-0/+1
|\| | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/ui/jobs/JobProgressUI.scala docs/_config.yml project/SparkBuild.scala repl/src/main/scala/org/apache/spark/repl/SparkILoop.scala
| * Merge remote-tracking branch 'old/master'Matei Zaharia2013-09-021-0/+11
| |\
| * \ Merge remote-tracking branch 'old/master'Matei Zaharia2013-09-011-25/+52
| |\ \
| * \ \ Merge remote-tracking branch 'old/master'Matei Zaharia2013-07-161-1/+1
| |\ \ \
| * | | | Test commit karma for Spark git.Henry Saputra2013-07-151-0/+1
| | | | |
* | | | | Merged with masterPrashant Sharma2013-09-061-24/+62
|\ \ \ \ \ | | |_|_|/ | |/| | |
| * | | | Add Apache incubator notice to READMEMatei Zaharia2013-09-021-0/+11
| | |_|/ | |/| |
| * | | Initial work to rename package to org.apache.sparkMatei Zaharia2013-09-011-1/+1
| | | |
| * | | Small fixes to READMEMatei Zaharia2013-08-311-26/+16
| | | |
| * | | Update some build instructions because only sbt assembly and mvn packageMatei Zaharia2013-08-291-5/+5
| | | | | | | | | | | | | | | | are now needed
| * | | Change build and run instructions to use assembliesMatei Zaharia2013-08-291-3/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit makes Spark invocation saner by using an assembly JAR to find all of Spark's dependencies instead of adding all the JARs in lib_managed. It also packages the examples into an assembly and uses that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script with two better-named scripts: "run-examples" for examples, and "spark-class" for Spark internal classes (e.g. REPL, master, etc). This is also designed to minimize the confusion people have in trying to use "run" to run their own classes; it's not meant to do that, but now at least if they look at it, they can modify run-examples to do a decent job for them. As part of this, Bagel's examples are also now properly moved to the examples package instead of bagel.
| * | | Use Hadoop 1.2.1 in application exampleJey Kottalam2013-08-211-5/+4
| | | |
| * | | Remove references to unsupported Hadoop versionsJey Kottalam2013-08-211-1/+1
| | | |
| * | | Example should make senseJey Kottalam2013-08-211-5/+5
| | | |
| * | | Update build docsJey Kottalam2013-08-211-4/+42
| | |/ | |/|
| * | Updating README to reflect Scala 2.9.3 requirementsKonstantin Boudnik2013-07-101-1/+1
| |/
* / Fixed pom.xml with updated dependencies.Prashant Sharma2013-04-291-3/+2
|/
* Add comment to README that 2.10 not yet supportedAndy Konwinski2013-03-261-3/+6
|
* Adds page to docs about building using Maven.Andy Konwinski2013-03-171-0/+2
| | | | | | | Adds links to new instructions in: * The main Spark project README.md * The docs nav menu called "More" * The docs Overview page under the "Building" and "Where to Go from Here" sections
* tweakMatei Zaharia2012-10-141-2/+2
|
* tweakMatei Zaharia2012-10-141-1/+1
|
* tweakMatei Zaharia2012-10-141-2/+2
|
* Update READMEMatei Zaharia2012-10-141-23/+19
|
* Simplify README even furtherMatei Zaharia2012-10-021-4/+2
|
* Changing version of Scala in READMEPatrick Wendell2012-10-021-1/+1
|
* Updated base README to point to documentation site instead of wiki, updatedAndy Konwinski2012-09-121-2/+2
| | | | | docs/README.md to describe use of Jekyll, and renmaed things to make them more consistent with the lower-case-with-hyphens convention.
* DocumentationMatei Zaharia2012-03-171-1/+1
|
* DocumentationMatei Zaharia2012-03-171-0/+12
|
* Fix Scala version requirement in READMEMatei Zaharia2011-11-031-2/+1
|