aboutsummaryrefslogtreecommitdiff
path: root/docs/_layouts
Commit message (Collapse)AuthorAgeFilesLines
* Merge pull request #566 from martinjaggi/copy-MLlib-d.Martin Jaggi2014-02-091-0/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | | | new MLlib documentation for optimization, regression and classification new documentation with tex formulas, hopefully improving usability and reproducibility of the offered MLlib methods. also did some minor changes in the code for consistency. scala tests pass. this is the rebased branch, i deleted the old PR jira: https://spark-project.atlassian.net/browse/MLLIB-19 Author: Martin Jaggi <m.jaggi@gmail.com> Closes #566 and squashes the following commits: 5f0f31e [Martin Jaggi] line wrap at 100 chars 4e094fb [Martin Jaggi] better description of GradientDescent 1d6965d [Martin Jaggi] remove broken url ea569c3 [Martin Jaggi] telling what updater actually does 964732b [Martin Jaggi] lambda R() in documentation a6c6228 [Martin Jaggi] better comments in SGD code for regression b32224a [Martin Jaggi] new optimization documentation d5dfef7 [Martin Jaggi] new classification and regression documentation b07ead6 [Martin Jaggi] correct scaling for MSE loss ba6158c [Martin Jaggi] use d for the number of features bab2ed2 [Martin Jaggi] renaming LeastSquaresGradient
* Merge pull request #552 from martinjaggi/master. Closes #552.Martin Jaggi2014-02-081-0/+13
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | tex formulas in the documentation using mathjax. and spliting the MLlib documentation by techniques see jira https://spark-project.atlassian.net/browse/MLLIB-19 and https://github.com/shivaram/spark/compare/mathjax Author: Martin Jaggi <m.jaggi@gmail.com> == Merge branch commits == commit 0364bfabbfc347f917216057a20c39b631842481 Author: Martin Jaggi <m.jaggi@gmail.com> Date: Fri Feb 7 03:19:38 2014 +0100 minor polishing, as suggested by @pwendell commit dcd2142c164b2f602bf472bb152ad55bae82d31a Author: Martin Jaggi <m.jaggi@gmail.com> Date: Thu Feb 6 18:04:26 2014 +0100 enabling inline latex formulas with $.$ same mathjax configuration as used in math.stackexchange.com sample usage in the linear algebra (SVD) documentation commit bbafafd2b497a5acaa03a140bb9de1fbb7d67ffa Author: Martin Jaggi <m.jaggi@gmail.com> Date: Thu Feb 6 17:31:29 2014 +0100 split MLlib documentation by techniques and linked from the main mllib-guide.md site commit d1c5212b93c67436543c2d8ddbbf610fdf0a26eb Author: Martin Jaggi <m.jaggi@gmail.com> Date: Thu Feb 6 16:59:43 2014 +0100 enable mathjax formula in the .md documentation files code by @shivaram commit d73948db0d9bc36296054e79fec5b1a657b4eab4 Author: Martin Jaggi <m.jaggi@gmail.com> Date: Thu Feb 6 16:57:23 2014 +0100 minor update on how to compile the documentation
* Merge pull request #497 from tdas/docs-updateTathagata Das2014-01-281-0/+11
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Updated Spark Streaming Programming Guide Here is the updated version of the Spark Streaming Programming Guide. This is still a work in progress, but the major changes are in place. So feedback is most welcome. In general, I have tried to make the guide to easier to understand even if the reader does not know much about Spark. The updated website is hosted here - http://www.eecs.berkeley.edu/~tdas/spark_docs/streaming-programming-guide.html The major changes are: - Overview illustrates the usecases of Spark Streaming - various input sources and various output sources - An example right after overview to quickly give an idea of what Spark Streaming program looks like - Made Java API and examples a first class citizen like Scala by using tabs to show both Scala and Java examples (similar to AMPCamp tutorial's code tabs) - Highlighted the DStream operations updateStateByKey and transform because of their powerful nature - Updated driver node failure recovery text to highlight automatic recovery in Spark standalone mode - Added information about linking and using the external input sources like Kafka and Flume - In general, reorganized the sections to better show the Basic section and the more advanced sections like Tuning and Recovery. Todos: - Links to the docs of external Kafka, Flume, etc - Illustrate window operation with figure as well as example. Author: Tathagata Das <tathagata.das1565@gmail.com> == Merge branch commits == commit 18ff10556570b39d672beeb0a32075215cfcc944 Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Tue Jan 28 21:49:30 2014 -0800 Fixed a lot of broken links. commit 34a5a6008dac2e107624c7ff0db0824ee5bae45f Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Tue Jan 28 18:02:28 2014 -0800 Updated github url to use SPARK_GITHUB_URL variable. commit f338a60ae8069e0a382d2cb170227e5757cc0b7a Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Mon Jan 27 22:42:42 2014 -0800 More updates based on Patrick and Harvey's comments. commit 89a81ff25726bf6d26163e0dd938290a79582c0f Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Mon Jan 27 13:08:34 2014 -0800 Updated docs based on Patricks PR comments. commit d5b6196b532b5746e019b959a79ea0cc013a8fc3 Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Sun Jan 26 20:15:58 2014 -0800 Added spark.streaming.unpersist config and info on StreamingListener interface. commit e3dcb46ab83d7071f611d9b5008ba6bc16c9f951 Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Sun Jan 26 18:41:12 2014 -0800 Fixed docs on StreamingContext.getOrCreate. commit 6c29524639463f11eec721e4d17a9d7159f2944b Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Thu Jan 23 18:49:39 2014 -0800 Added example and figure for window operations, and links to Kafka and Flume API docs. commit f06b964a51bb3b21cde2ff8bdea7d9785f6ce3a9 Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Wed Jan 22 22:49:12 2014 -0800 Fixed missing endhighlight tag in the MLlib guide. commit 036a7d46187ea3f2a0fb8349ef78f10d6c0b43a9 Merge: eab351d a1cd185 Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Wed Jan 22 22:17:42 2014 -0800 Merge remote-tracking branch 'apache/master' into docs-update commit eab351d05c0baef1d4b549e1581310087158d78d Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Wed Jan 22 22:17:15 2014 -0800 Update Spark Streaming Programming Guide.
* Addressing comment about Graph Processing in docs.Joseph E. Gonzalez2014-01-111-2/+2
|
* Soften wording about GraphX superseding BagelAnkur Dave2014-01-101-2/+2
|
* Add back Bagel links to docs, but mark them supersededAnkur Dave2014-01-101-1/+3
|
* WIP. Updating figures and cleaning up initial skeleton for GraphX ↵Joseph E. Gonzalez2014-01-101-5/+5
| | | | Programming guide.
* SPARK-917 Improve API links in nav barPatrick Wendell2013-12-071-4/+4
|
* Merging build changes in from 0.8Patrick Wendell2013-10-051-2/+2
|
* Added cluster overview doc, made logo higher-resolution, and added moreMatei Zaharia2013-09-081-1/+2
| | | | details on monitoring
* Work in progress:Matei Zaharia2013-09-081-1/+3
| | | | | | | - Add job scheduling docs - Rename some fair scheduler properties - Organize intro page better - Link to Apache wiki for "contributing to Spark"
* Merge pull request #900 from pwendell/cdh-docsMatei Zaharia2013-09-081-0/+1
|\ | | | | Provide docs to describe running on CDH/HDP cluster.
| * File renamePatrick Wendell2013-09-071-1/+1
| |
| * Provide docs to describe running on CDH/HDP cluster.Patrick Wendell2013-09-061-0/+1
| | | | | | | | This doc consolidates information relevant to CDH/HDP users in a single place.
* | Docs describing Spark monitoring and instrumentationPatrick Wendell2013-09-061-0/+1
|/
* More updates, describing changes to recommended use of environment varsMatei Zaharia2013-08-311-1/+1
| | | | and new Python stuff
* More doc improvements + better warnings when you haven't built SparkMatei Zaharia2013-08-301-4/+11
|
* New hardware provisioning doc, and updates to menusMatei Zaharia2013-08-301-9/+13
|
* Add ML Lib scaladoc to API dropdownShivaram Venkataraman2013-08-111-0/+1
|
* Adds page to docs about building using Maven.Andy Konwinski2013-03-171-0/+1
| | | | | | | Adds links to new instructions in: * The main Spark project README.md * The docs nav menu called "More" * The docs Overview page under the "Building" and "Where to Go from Here" sections
* Added commented-out Google analytics code for website docsMatei Zaharia2013-02-271-0/+16
|
* Some tweaks to docsMatei Zaharia2013-02-251-3/+3
|
* Merge branch 'master' into streamingTathagata Das2013-01-151-4/+4
|\ | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/FilteredRDD.scala docs/_layouts/global.html docs/index.md run
| * Merge remote-tracking branch 'origin/master' into python-apiJosh Rosen2012-12-291-1/+1
| |\ | | | | | | | | | | | | Conflicts: docs/quick-start.md
| * | Add documentation for Python API.Josh Rosen2012-12-281-0/+1
| | |
| * | Add epydoc API documentation for PySpark.Josh Rosen2012-12-271-2/+8
| | |
* | | Updated Streaming Programming Guide.Tathagata Das2013-01-011-2/+10
| | |
* | | Streaming programming guide. STREAMING-2 #resolvePatrick Wendell2012-11-131-0/+1
| |/ |/|
* | Fix a path in the web UIMatei Zaharia2012-10-201-1/+1
|/
* Some doc fixes, including showing version number in nav bar againMatei Zaharia2012-10-131-1/+3
|
* Updates to documentation:Matei Zaharia2012-10-091-5/+5
| | | | | | | | - Edited quick start and tuning guide to simplify them a little - Simplified top menu bar - Made private a SparkContext constructor parameter that was left as public - Various small fixes
* Updating lots of docs to use the new special version number variables,Andy Konwinski2012-10-081-4/+5
| | | | | also adding the version to the navbar so it is easy to tell which version of Spark these docs were compiled for.
* Adds liquid variables to docs templating system so that they can be usedAndy Konwinski2012-10-081-16/+16
| | | | | | | | | throughout the docs: SPARK_VERSION, SCALA_VERSION, and MESOS_VERSION. To use them, e.g. use {{site.SPARK_VERSION}}. Also removes uses of {{HOME_PATH}} which were being resolved to "" by the templating system anyway.
* Links quick start from nav barMatei Zaharia2012-10-051-0/+1
|
* Updates to standalone cluster, web UI and deploy docs.Matei Zaharia2012-09-261-1/+1
|
* More updates to docs, including tuning guideMatei Zaharia2012-09-261-0/+1
|
* Doc fixesMatei Zaharia2012-09-251-1/+1
|
* Various enhancements to the programming guide and HTML/CSSMatei Zaharia2012-09-251-5/+22
|
* More updates to documentationMatei Zaharia2012-09-251-1/+1
|
* Update license info on deploy scriptsMatei Zaharia2012-09-251-26/+11
|
* - Add docs/api to .gitignoreAndy Konwinski2012-09-161-8/+38
| | | | | | | | | | | | | - Rework/expand the nav bar with more of the docs site - Removing parts of docs about EC2 and Mesos that differentiate between running 0.5 and before - Merged subheadings from running-on-amazon-ec2.html that are still relevant (i.e., "Using a newer version of Spark" and "Accessing Data in S3") into ec2-scripts.html and deleted running-on-amazon-ec2.html - Added some TODO comments to a few docs - Updated the blurb about AMP Camp - Renamed programming-guide to spark-programming-guide - Fixing typos/etc. in Standalone Spark doc
* Re-enabling responsive for better looking padding and more sane resizing,Andy Konwinski2012-09-131-28/+20
| | | | but removed the collapsable stuff from the nav bar.
* More crisp logo created from vector source (ai) and disabledAndy Konwinski2012-09-131-2/+3
| | | | | responsive css (so nav menu doesn't switch to collapsed version for narrow viewports).
* Replaces "Spark" word in nav bar with logo.Andy Konwinski2012-09-131-1/+1
|
* Merge remote-tracking branch 'public-spark/dev' into docAndy Konwinski2012-09-131-1/+1
|\
| * Fixed navbar style problemDenny2012-09-131-1/+1
| |
* | Making the link to api scaladocs work and migrating other code snippetsAndy Konwinski2012-09-121-1/+1
|/ | | | to use pygments syntax highlighting.
* Small tweaks to generated doc pagesMatei Zaharia2012-09-121-0/+2
|
* Adds syntax highlighting (via pygments), and some style tweaks to make thingsAndy Konwinski2012-09-121-8/+9
| | | | easier to read.
* Adding docs directory containing documentation currently on the wikiAndy Konwinski2012-09-122-0/+266
which can be compiled via jekyll, using the command `jekyll`. To compile and run a local webserver to serve the doc as a website, run `jekyll --server`.