aboutsummaryrefslogtreecommitdiff
path: root/docs/index.md
Commit message (Collapse)AuthorAgeFilesLines
* Removed reference to incubation in Spark user docs.Reynold Xin2014-02-271-6/+6
| | | | | | | | Author: Reynold Xin <rxin@apache.org> Closes #2 from rxin/docs and squashes the following commits: 08bbd5f [Reynold Xin] Removed reference to incubation in Spark user docs.
* [SPARK-1105] fix site scala version error in docsCodingCat2014-02-191-1/+1
| | | | | | | | | | | | | https://spark-project.atlassian.net/browse/SPARK-1105 fix site scala version error Author: CodingCat <zhunansjtu@gmail.com> Closes #618 from CodingCat/doc_version and squashes the following commits: 39bb8aa [CodingCat] more fixes 65bedb0 [CodingCat] fix site scala version error in doc
* Merge pull request #497 from tdas/docs-updateTathagata Das2014-01-281-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Updated Spark Streaming Programming Guide Here is the updated version of the Spark Streaming Programming Guide. This is still a work in progress, but the major changes are in place. So feedback is most welcome. In general, I have tried to make the guide to easier to understand even if the reader does not know much about Spark. The updated website is hosted here - http://www.eecs.berkeley.edu/~tdas/spark_docs/streaming-programming-guide.html The major changes are: - Overview illustrates the usecases of Spark Streaming - various input sources and various output sources - An example right after overview to quickly give an idea of what Spark Streaming program looks like - Made Java API and examples a first class citizen like Scala by using tabs to show both Scala and Java examples (similar to AMPCamp tutorial's code tabs) - Highlighted the DStream operations updateStateByKey and transform because of their powerful nature - Updated driver node failure recovery text to highlight automatic recovery in Spark standalone mode - Added information about linking and using the external input sources like Kafka and Flume - In general, reorganized the sections to better show the Basic section and the more advanced sections like Tuning and Recovery. Todos: - Links to the docs of external Kafka, Flume, etc - Illustrate window operation with figure as well as example. Author: Tathagata Das <tathagata.das1565@gmail.com> == Merge branch commits == commit 18ff10556570b39d672beeb0a32075215cfcc944 Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Tue Jan 28 21:49:30 2014 -0800 Fixed a lot of broken links. commit 34a5a6008dac2e107624c7ff0db0824ee5bae45f Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Tue Jan 28 18:02:28 2014 -0800 Updated github url to use SPARK_GITHUB_URL variable. commit f338a60ae8069e0a382d2cb170227e5757cc0b7a Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Mon Jan 27 22:42:42 2014 -0800 More updates based on Patrick and Harvey's comments. commit 89a81ff25726bf6d26163e0dd938290a79582c0f Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Mon Jan 27 13:08:34 2014 -0800 Updated docs based on Patricks PR comments. commit d5b6196b532b5746e019b959a79ea0cc013a8fc3 Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Sun Jan 26 20:15:58 2014 -0800 Added spark.streaming.unpersist config and info on StreamingListener interface. commit e3dcb46ab83d7071f611d9b5008ba6bc16c9f951 Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Sun Jan 26 18:41:12 2014 -0800 Fixed docs on StreamingContext.getOrCreate. commit 6c29524639463f11eec721e4d17a9d7159f2944b Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Thu Jan 23 18:49:39 2014 -0800 Added example and figure for window operations, and links to Kafka and Flume API docs. commit f06b964a51bb3b21cde2ff8bdea7d9785f6ce3a9 Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Wed Jan 22 22:49:12 2014 -0800 Fixed missing endhighlight tag in the MLlib guide. commit 036a7d46187ea3f2a0fb8349ef78f10d6c0b43a9 Merge: eab351d a1cd185 Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Wed Jan 22 22:17:42 2014 -0800 Merge remote-tracking branch 'apache/master' into docs-update commit eab351d05c0baef1d4b549e1581310087158d78d Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Wed Jan 22 22:17:15 2014 -0800 Update Spark Streaming Programming Guide.
* Soften wording about GraphX superseding BagelAnkur Dave2014-01-101-2/+2
|
* Add back Bagel links to docs, but mark them supersededAnkur Dave2014-01-101-1/+3
|
* WIP. Updating figures and cleaning up initial skeleton for GraphX ↵Joseph E. Gonzalez2014-01-101-3/+3
| | | | Programming guide.
* Code review feedbackHolden Karau2014-01-051-3/+3
|
* Merge remote-tracking branch 'apache-github/master' into remove-binariesPatrick Wendell2014-01-031-5/+5
|\ | | | | | | | | | | Conflicts: core/src/test/scala/org/apache/spark/DriverSuite.scala docs/python-programming-guide.md
| * pyspark -> bin/pysparkPrashant Sharma2014-01-021-1/+1
| |
| * run-example -> bin/run-examplePrashant Sharma2014-01-021-3/+3
| |
| * spark-shell -> bin/spark-shellPrashant Sharma2014-01-021-1/+1
| |
* | Removed sbt folder and changed docs accordinglyPrashant Sharma2014-01-021-3/+3
|/
* Various broken links in documentationPatrick Wendell2013-12-071-1/+1
|
* Minor doc fixes and updating READMEPatrick Wendell2013-12-061-1/+1
|
* more docsAli Ghodsi2013-12-061-1/+3
|
* Updated documentation about the YARN v2.2 build processAli Ghodsi2013-12-061-1/+1
|
* Added cluster overview doc, made logo higher-resolution, and added moreMatei Zaharia2013-09-081-5/+0
| | | | details on monitoring
* Work in progress:Matei Zaharia2013-09-081-11/+15
| | | | | | | - Add job scheduling docs - Rename some fair scheduler properties - Organize intro page better - Link to Apache wiki for "contributing to Spark"
* CR feedback from MateiEvan Chan2013-09-071-3/+0
|
* Add references to make-distribution.shEvan Chan2013-09-061-0/+8
|
* Some doc improvementsMatei Zaharia2013-09-021-1/+11
| | | | | - List higher-level projects that run on Spark - Tweak CSS
* Doc improvementsMatei Zaharia2013-09-011-0/+4
|
* Fix more URLs in docsMatei Zaharia2013-09-011-1/+1
|
* Update docs for new packageMatei Zaharia2013-09-011-4/+4
|
* Fixes suggested by PatrickMatei Zaharia2013-08-311-4/+5
|
* More updates, describing changes to recommended use of environment varsMatei Zaharia2013-08-311-1/+1
| | | | and new Python stuff
* Update docs about HDFS versionsMatei Zaharia2013-08-301-16/+11
|
* More doc improvements + better warnings when you haven't built SparkMatei Zaharia2013-08-301-21/+32
|
* Update some build instructions because only sbt assembly and mvn packageMatei Zaharia2013-08-291-1/+1
| | | | are now needed
* Change build and run instructions to use assembliesMatei Zaharia2013-08-291-2/+2
| | | | | | | | | | | | | | | | This commit makes Spark invocation saner by using an assembly JAR to find all of Spark's dependencies instead of adding all the JARs in lib_managed. It also packages the examples into an assembly and uses that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script with two better-named scripts: "run-examples" for examples, and "spark-class" for Spark internal classes (e.g. REPL, master, etc). This is also designed to minimize the confusion people have in trying to use "run" to run their own classes; it's not meant to do that, but now at least if they look at it, they can modify run-examples to do a decent job for them. As part of this, Bagel's examples are also now properly moved to the examples package instead of bagel.
* Updated link to SBTMatei Zaharia2013-04-071-1/+1
|
* Adds page to docs about building using Maven.Andy Konwinski2013-03-171-0/+3
| | | | | | | Adds links to new instructions in: * The main Spark project README.md * The docs nav menu called "More" * The docs Overview page under the "Building" and "Where to Go from Here" sections
* More doc tweaksMatei Zaharia2013-02-261-2/+3
|
* Some tweaks to docsMatei Zaharia2013-02-261-7/+1
|
* Some tweaks to docsMatei Zaharia2013-02-251-1/+1
|
* Merge branch 'master' into streamingTathagata Das2013-01-151-6/+12
|\ | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala docs/_layouts/global.html docs/index.md run
| * Minor documentation and style fixes for PySpark.Josh Rosen2013-01-011-2/+6
| |
| * Add documentation for Python API.Josh Rosen2012-12-281-5/+6
| |
* | Streaming programming guide. STREAMING-2 #resolvePatrick Wendell2012-11-131-0/+1
|/
* Some doc fixes, including showing version number in nav bar againMatei Zaharia2012-10-131-4/+4
|
* Updates to documentation:Matei Zaharia2012-10-091-7/+4
| | | | | | | | - Edited quick start and tuning guide to simplify them a little - Simplified top menu bar - Made private a SparkContext constructor parameter that was left as public - Various small fixes
* Merge pull request #260 from andyk/update-docs-to-use-version-varsMatei Zaharia2012-10-091-1/+1
|\ | | | | Updates docs to use the new version num vars and adds Spark version in nav bar
| * Updating lots of docs to use the new special version number variables,Andy Konwinski2012-10-081-1/+1
| | | | | | | | | | also adding the version to the navbar so it is easy to tell which version of Spark these docs were compiled for.
* | Adding new download instructionsPatrick Wendell2012-10-081-1/+1
|/
* Adds liquid variables to docs templating system so that they can be usedAndy Konwinski2012-10-081-13/+13
| | | | | | | | | throughout the docs: SPARK_VERSION, SCALA_VERSION, and MESOS_VERSION. To use them, e.g. use {{site.SPARK_VERSION}}. Also removes uses of {{HOME_PATH}} which were being resolved to "" by the templating system anyway.
* A Spark "Quick Start" examplePatrick Wendell2012-10-011-0/+4
| | | | | | | This commit includes a quick start example that covers: 1) Basic usage of the Spark shell 2) A simple Spark job in Scala 3) A simple Spark job in Java
* Updates to standalone cluster, web UI and deploy docs.Matei Zaharia2012-09-261-2/+2
|
* More updates to docs, including tuning guideMatei Zaharia2012-09-261-0/+1
|
* Doc fixesMatei Zaharia2012-09-251-0/+4
|
* Various enhancements to the programming guide and HTML/CSSMatei Zaharia2012-09-251-2/+6
|
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-08 15:44:12 +0000