aboutsummaryrefslogtreecommitdiff
path: root/examples
Commit message (Collapse)AuthorAgeFilesLines
* make SparkHadoopUtil a member of SparkEnvJey Kottalam2013-08-151-2/+1
|
* Merge pull request #762 from shivaram/sgd-cleanupEvan Sparks2013-08-111-0/+85
|\ | | | | Refactor SGD options into a new class.
| * Add setters for optimizer, gradient in SGD.Shivaram Venkataraman2013-08-081-1/+1
| | | | | | | | Also remove java-specific constructor for LabeledPoint.
| * Merge branch 'master' of git://github.com/mesos/spark into sgd-cleanupShivaram Venkataraman2013-08-061-0/+116
| |\ | | | | | | | | | | | | Conflicts: mllib/src/main/scala/spark/mllib/util/MLUtils.scala
| * | Refactor GLM algorithms and add Java testsShivaram Venkataraman2013-08-061-0/+85
| | | | | | | | | | | | | | | | | | | | | | | | | | | This change adds Java examples and unit tests for all GLM algorithms to make sure the MLLib interface works from Java. Changes include - Introduce LabeledPoint and avoid using Doubles in train arguments - Rename train to run in class methods - Make the optimizer a member variable of GLM to make sure the builder pattern works
* | | Fixed path to JavaALS.java and JavaKMeans.java, fixed hadoop2-yarn profileAlexander Pivovarov2013-08-103-0/+6
| | |
* | | Optimize Scala PageRank to use reduceByKeyMatei Zaharia2013-08-101-8/+4
| | |
* | | Merge pull request #789 from MLnick/masterMatei Zaharia2013-08-101-0/+50
|\ \ \ | | | | | | | | Adding Scala version of PageRank example
| * | | Style changes as per Matei's commentsNick Pentreath2013-08-081-9/+8
| | | |
| * | | Adding Scala version of PageRank exampleNick Pentreath2013-08-071-0/+51
| | |/ | |/|
* | | Merge pull request #786 from shivaram/mllib-javaMatei Zaharia2013-08-093-0/+180
|\ \ \ | | | | | | | | Java fixes, tests and examples for ALS, KMeans
| * | | Remove Java-specific constructor for Rating.Shivaram Venkataraman2013-08-081-3/+3
| | | | | | | | | | | | | | | | | | | | The scala constructor works for native type java types. Modify examples to match this.
| * | | Java examples, tests for KMeans and ALSShivaram Venkataraman2013-08-063-0/+180
| |/ / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Changes ALS to accept RDD[Rating] instead of (Int, Int, Double) making it easier to call from Java - Renames class methods from `train` to `run` to enable static methods to be called from Java. - Add unit tests which check if both static / class methods can be called. - Also add examples which port the main() function in ALS, KMeans to the examples project. Couple of minor changes to existing code: - Add a toJavaRDD method in RDD to convert scala RDD to java RDD easily - Workaround a bug where using double[] from Java leads to class cast exception in KMeans init
* / / Optimize JavaPageRank to use reduceByKey instead of groupByKeyMatei Zaharia2013-08-081-9/+8
|/ /
* | Got rid of unnecessary map functionstayhf2013-08-061-6/+2
| |
* | changes as reviewer requestedstayhf2013-08-061-10/+1
| |
* | Updated code with reviewer's suggestionsstayhf2013-08-051-47/+47
| |
* | Simple PageRank algorithm implementation in Java for SPARK-760stayhf2013-08-031-0/+129
|/
* Add Apache license headers and LICENSE and NOTICE filesMatei Zaharia2013-07-1645-1/+766
|
* pom cleanupMark Hamstra2013-07-081-1/+0
|
* Explicit dependencies for scala-library and scalap to prevent 2.9.2 vs. ↵Mark Hamstra2013-07-081-0/+5
| | | | 2.9.3 problems
* Fixing missed hbase dependency in examples hadoop2-yarn profileKonstantin Boudnik2013-07-011-0/+5
|
* Merge pull request #577 from skumargithub/masterMatei Zaharia2013-06-291-0/+50
|\ | | | | Example of cumulative counting using updateStateByKey
| * Removed unused code, clarified intent of the program, batch size to 1 secondunknown2013-05-061-5/+3
| |
| * Modified as per TD's suggestionsunknown2013-04-301-17/+6
| |
| * Examaple of cumulative counting using updateStateByKeyunknown2013-04-221-0/+63
| |
* | Merge remote-tracking branch 'mrpotes/master'Matei Zaharia2013-06-293-15/+12
|\ \
| * | Fix usage and parameter extractionJames Phillpotts2013-06-253-12/+9
| | |
| * | Include a default OAuth implementation, and update examples and ↵James Phillpotts2013-06-253-3/+3
| | | | | | | | | | | | JavaStreamingContext
* | | Merge branch 'master' into streamingTathagata Das2013-06-2441-167/+825
|\| | | | | | | | | | | | | | Conflicts: .gitignore
| * | Merge remote-tracking branch 'milliondreams/casdemo'Matei Zaharia2013-06-182-0/+231
| |\ \ | | | | | | | | | | | | | | | | Conflicts: project/SparkBuild.scala
| | * | Fixing the style as per feedbackRohit Rai2013-06-131-35/+37
| | | |
| | * | Example to write the output to cassandraRohit Rai2013-06-031-5/+43
| | | |
| | * | A better way to read column value if you are sure the column exists in every ↵Rohit Rai2013-06-031-2/+4
| | | | | | | | | | | | | | | | row.
| | * | Adding deps to examples/pom.xmlRohit Rai2013-06-021-0/+35
| | | | | | | | | | | | | | | | Fixing exclusion in examples deps in SparkBuild.scala
| | * | Removing infix callRohit Rai2013-06-021-3/+3
| | | |
| | * | Adding example to make Spark RDD from CassandraRohit Rai2013-06-011-0/+154
| | | |
| * | | Add hBase dependency to examples POMEthan Jewett2013-05-201-0/+10
| | | |
| * | | Add hBase exampleEthan Jewett2013-05-091-0/+35
| | | |
| * | | Revert "Merge pull request #596 from esjewett/master" because theReynold Xin2013-05-091-35/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | dependency on hbase introduces netty-3.2.2 which conflicts with netty-3.5.3 already in Spark. This caused multiple test failures. This reverts commit 0f1b7a06e1f6782711170234f105f1b277e3b04c, reversing changes made to aacca1b8a85bd073ce185a06d6470b070761b2f4.
| * | | Switch to using SparkContext method to create RDDEthan Jewett2013-05-071-2/+2
| | | |
| * | | Fix indents and mention other configuration optionsEthan Jewett2013-05-041-2/+5
| | | |
| * | | Remove unnecessary column family configEthan Jewett2013-05-041-4/+2
| | | |
| * | | HBase exampleEthan Jewett2013-05-041-0/+34
| |/ /
| * | Attempt at fixing merge conflictMridul Muralidharan2013-04-246-79/+79
| |\|
| | * Uniform whitespace across scala examplesAndrew Ash2013-04-094-76/+76
| | |
| | * Merge remote-tracking branch 'jey/bump-development-version-to-0.8.0'Matei Zaharia2013-04-081-1/+1
| | |\ | | | | | | | | | | | | | | | | | | | | Conflicts: docs/_config.yml project/SparkBuild.scala
| | | * Bump development version to 0.8.0Jey Kottalam2013-03-281-1/+1
| | | |
| | * | Merge pull request #552 from MLnick/masterMatei Zaharia2013-04-071-1/+1
| | |\ \ | | | | | | | | | | Bumping version for Twitter Algebird to latest
| | | * | Bumping Algebird version in examples now that it supports JDK 1.6Nick Pentreath2013-04-031-1/+1
| | | |/
generated by cgit v1.2.3 (git 2.39.1) at 2024-08-10 08:07:52 +0000