aboutsummaryrefslogtreecommitdiff
path: root/docs/mllib-guide.md
Commit message (Collapse)AuthorAgeFilesLines
...
* Merge pull request #497 from tdas/docs-updateTathagata Das2014-01-281-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Updated Spark Streaming Programming Guide Here is the updated version of the Spark Streaming Programming Guide. This is still a work in progress, but the major changes are in place. So feedback is most welcome. In general, I have tried to make the guide to easier to understand even if the reader does not know much about Spark. The updated website is hosted here - http://www.eecs.berkeley.edu/~tdas/spark_docs/streaming-programming-guide.html The major changes are: - Overview illustrates the usecases of Spark Streaming - various input sources and various output sources - An example right after overview to quickly give an idea of what Spark Streaming program looks like - Made Java API and examples a first class citizen like Scala by using tabs to show both Scala and Java examples (similar to AMPCamp tutorial's code tabs) - Highlighted the DStream operations updateStateByKey and transform because of their powerful nature - Updated driver node failure recovery text to highlight automatic recovery in Spark standalone mode - Added information about linking and using the external input sources like Kafka and Flume - In general, reorganized the sections to better show the Basic section and the more advanced sections like Tuning and Recovery. Todos: - Links to the docs of external Kafka, Flume, etc - Illustrate window operation with figure as well as example. Author: Tathagata Das <tathagata.das1565@gmail.com> == Merge branch commits == commit 18ff10556570b39d672beeb0a32075215cfcc944 Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Tue Jan 28 21:49:30 2014 -0800 Fixed a lot of broken links. commit 34a5a6008dac2e107624c7ff0db0824ee5bae45f Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Tue Jan 28 18:02:28 2014 -0800 Updated github url to use SPARK_GITHUB_URL variable. commit f338a60ae8069e0a382d2cb170227e5757cc0b7a Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Mon Jan 27 22:42:42 2014 -0800 More updates based on Patrick and Harvey's comments. commit 89a81ff25726bf6d26163e0dd938290a79582c0f Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Mon Jan 27 13:08:34 2014 -0800 Updated docs based on Patricks PR comments. commit d5b6196b532b5746e019b959a79ea0cc013a8fc3 Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Sun Jan 26 20:15:58 2014 -0800 Added spark.streaming.unpersist config and info on StreamingListener interface. commit e3dcb46ab83d7071f611d9b5008ba6bc16c9f951 Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Sun Jan 26 18:41:12 2014 -0800 Fixed docs on StreamingContext.getOrCreate. commit 6c29524639463f11eec721e4d17a9d7159f2944b Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Thu Jan 23 18:49:39 2014 -0800 Added example and figure for window operations, and links to Kafka and Flume API docs. commit f06b964a51bb3b21cde2ff8bdea7d9785f6ce3a9 Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Wed Jan 22 22:49:12 2014 -0800 Fixed missing endhighlight tag in the MLlib guide. commit 036a7d46187ea3f2a0fb8349ef78f10d6c0b43a9 Merge: eab351d a1cd185 Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Wed Jan 22 22:17:42 2014 -0800 Merge remote-tracking branch 'apache/master' into docs-update commit eab351d05c0baef1d4b549e1581310087158d78d Author: Tathagata Das <tathagata.das1565@gmail.com> Date: Wed Jan 22 22:17:15 2014 -0800 Update Spark Streaming Programming Guide.
* Merge remote-tracking branch 'upstream/master' into sparsesvdReza Zadeh2014-01-171-1/+2
|\
| * Clarify that Python 2.7 is only needed for MLlibMatei Zaharia2014-01-151-1/+2
| |
* | 0index docsReza Zadeh2014-01-171-1/+1
| |
* | use 0-indexingReza Zadeh2014-01-171-2/+2
| |
* | changes from PRReza Zadeh2014-01-171-2/+3
| |
* | Merge remote-tracking branch 'upstream/master' into sparsesvdReza Zadeh2014-01-131-5/+14
|\|
| * Update some Python MLlib parameters to use camelCase, and tweak docsMatei Zaharia2014-01-111-0/+9
| | | | | | | | | | | | | | We've used camel case in other Spark methods so it felt reasonable to keep using it here and make the code match Scala/Java as much as possible. Note that parameter names matter in Python because it allows passing optional parameters by name.
| * Add Naive Bayes to Python MLlib, and some API fixesMatei Zaharia2014-01-111-5/+5
| | | | | | | | | | | | | | | | | | | | | | | | - Added a Python wrapper for Naive Bayes - Updated the Scala Naive Bayes to match the style of our other algorithms better and in particular make it easier to call from Java (added builder pattern, removed default value in train method) - Updated Python MLlib functions to not require a SparkContext; we can get that from the RDD the user gives - Added a toString method in LabeledPoint - Made the Python MLlib tests run as part of run-tests as well (before they could only be run individually through each file)
* | Merge remote-tracking branch 'upstream/master' into sparsesvdReza Zadeh2014-01-091-67/+277
|\| | | | | | | | | Conflicts: docs/mllib-guide.md
| * Fixed merge conflictHossein Falaki2014-01-071-5/+1
| |\
| | * spark-shell -> bin/spark-shellPrashant Sharma2014-01-021-1/+1
| | |
| * | Added proper evaluation example for collaborative filtering and fixed typoHossein Falaki2014-01-061-4/+8
| | |
| * | Added table of contents and minor fixesHossein Falaki2014-01-031-8/+16
| | |
| * | Commented the last part of collaborative filtering examples that lead to errorsHossein Falaki2014-01-021-5/+6
| | |
| * | Added Scala and Python examples for mllibHossein Falaki2014-01-021-52/+261
| |/
* | documentation for sparsematrixReza Zadeh2014-01-071-3/+4
| |
* | fix docs to use SparseMatrixReza Zadeh2014-01-051-2/+5
| |
* | add k parameterReza Zadeh2014-01-041-2/+3
| |
* | doc tweaksReza Zadeh2014-01-011-1/+1
| |
* | doc tweakReza Zadeh2014-01-011-4/+5
| |
* | doc tweaksReza Zadeh2014-01-011-4/+4
| |
* | New documentationReza Zadeh2014-01-011-0/+52
|/
* Adding implicit feedback ALS to MLlib user guideNick Pentreath2013-10-041-4/+20
|
* Document fortran dependency for MLBasePatrick Wendell2013-09-091-0/+7
|
* Small tweaks to MLlib docsMatei Zaharia2013-09-081-10/+8
|
* respose to PR commentsAmeet Talwalkar2013-09-081-25/+30
|
* updates based on comments to PRAmeet Talwalkar2013-09-081-49/+83
|
* updated contentAmeet Talwalkar2013-09-051-1/+147
|
* More updates, describing changes to recommended use of environment varsMatei Zaharia2013-08-311-0/+6
and new Python stuff
generated by cgit v1.2.3 (git 2.39.1) at 2024-07-19 05:07:07 +0000