aboutsummaryrefslogtreecommitdiff
path: root/mllib
Commit message (Collapse)AuthorAgeFilesLines
* Merge remote-tracking branch 'upstream/master' into sparsesvdReza Zadeh2014-01-097-5/+443
|\ | | | | | | | | Conflicts: docs/mllib-guide.md
| * Merge branch 'master' into MatrixFactorizationModel-fixHossein Falaki2014-01-074-2/+345
| |\
| | * Added GradientDescentSuiteXusen Yin2014-01-061-0/+116
| | |
| | * fix logistic loss bugXusen Yin2014-01-061-2/+2
| | |
| | * Merge pull request #292 from soulmachine/naive-bayesReynold Xin2014-01-042-0/+227
| | |\ | | | | | | | | | | | | | | | | | | | | standard Naive Bayes classifier Has implemented the standard Naive Bayes classifier. This is an updated version of #288, which is closed because of misoperations.
| | | * Aggregated all sample points to driver without any shuffleLian, Cheng2014-01-022-53/+31
| | | |
| | | * Response to comments from Reynold, Ameet and EvanLian, Cheng2013-12-302-62/+90
| | | | | | | | | | | | | | | | | | | | | | | | | | | | * Arguments renamed according to Ameet's suggestion * Using DoubleMatrix instead of Array[Double] in computation * Removed arguments C (kinds of label) and D (dimension of feature vector) from NaiveBayes.train() * Replaced reduceByKey with foldByKey to avoid modifying original input data
| | | * Response to Reynold's commentsLian, Cheng2013-12-291-10/+16
| | | |
| | | * Added Apache license header to NaiveBayesSuiteLian, Cheng2013-12-271-0/+17
| | | |
| | | * Reformatted some lines commented by MateiLian, Cheng2013-12-271-2/+3
| | | |
| | | * Let reduceByKey to take care of local combineLian, Cheng2013-12-251-27/+16
| | | | | | | | | | | | | | | | Also refactored some heavy FP code to improve readability and reduce memory footprint.
| | | * Refactored NaiveBayesLian, Cheng2013-12-252-28/+41
| | | | | | | | | | | | | | | | | | | | * Minimized shuffle output with mapPartitions. * Reduced RDD actions from 3 to 1.
| | | * standard Naive Bayes classifierFrank Dai2013-12-252-0/+195
| | | |
| * | | Added Rating deserializerHossein Falaki2014-01-061-1/+8
| | | |
| * | | Added serializing method for Rating objectHossein Falaki2014-01-061-4/+16
| | | |
| * | | Added python binding for bulk recommendationHossein Falaki2014-01-042-1/+27
| | | |
| * | | Removed unnecessary blank lineHossein Falaki2014-01-031-1/+0
| | | |
| * | | Added unit tests for bulk prediction in MatrixFactorizationModelHossein Falaki2014-01-031-2/+31
| | | |
| * | | Added a method to enable bulk predictionHossein Falaki2014-01-031-1/+23
| |/ /
* | | More sparse matrix usage.Reza Zadeh2014-01-071-1/+2
| | |
* | | use SparseMatrix everywhereReza Zadeh2014-01-044-71/+84
| | |
* | | prettifyReza Zadeh2014-01-042-21/+22
| | |
* | | new example fileReza Zadeh2014-01-041-1/+0
| | |
* | | fix testsReza Zadeh2014-01-042-20/+36
| | |
* | | set methodsReza Zadeh2014-01-041-7/+52
| | |
* | | add k parameterReza Zadeh2014-01-042-14/+13
| | |
* | | using decomposed matrix struct nowReza Zadeh2014-01-043-17/+16
| | |
* | | new return structReza Zadeh2014-01-041-0/+33
| | |
* | | start using matrixentryReza Zadeh2014-01-031-9/+14
| | |
* | | rename sparsesvd.scalaReza Zadeh2014-01-031-0/+0
| | |
* | | New matrix entry fileReza Zadeh2014-01-031-0/+27
| | |
* | | fix error messageReza Zadeh2014-01-021-1/+1
| | |
* | | Merge remote-tracking branch 'upstream/master' into sparsesvdReza Zadeh2014-01-021-7/+6
|\| |
| * | Merge remote-tracking branch 'origin/master' into conf2Matei Zaharia2013-12-291-0/+232
| |\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/SparkContext.scala core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala core/src/main/scala/org/apache/spark/scheduler/cluster/ClusterTaskSetManager.scala core/src/main/scala/org/apache/spark/scheduler/local/LocalScheduler.scala core/src/main/scala/org/apache/spark/util/MetadataCleaner.scala core/src/test/scala/org/apache/spark/scheduler/TaskResultGetterSuite.scala core/src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scala new-yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobGenerator.scala streaming/src/test/scala/org/apache/spark/streaming/BasicOperationsSuite.scala streaming/src/test/scala/org/apache/spark/streaming/CheckpointSuite.scala streaming/src/test/scala/org/apache/spark/streaming/InputStreamsSuite.scala streaming/src/test/scala/org/apache/spark/streaming/TestSuiteBase.scala streaming/src/test/scala/org/apache/spark/streaming/WindowOperationsSuite.scala
| * | | Various fixes to configuration codeMatei Zaharia2013-12-281-5/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Got rid of global SparkContext.globalConf - Pass SparkConf to serializers and compression codecs - Made SparkConf public instead of private[spark] - Improved API of SparkContext and SparkConf - Switched executor environment vars to be passed through SparkConf - Fixed some places that were still using system properties - Fixed some tests, though others are still failing This still fails several tests in core, repl and streaming, likely due to properties not being set or cleared correctly (some of the tests run fine in isolation).
| * | | spark-544, introducing SparkConf and related configuration overhaul.Prashant Sharma2013-12-251-7/+6
| | |/ | |/|
* | | more docs yayReza Zadeh2014-01-011-1/+4
| | |
* | | javadoc for sparsesvdReza Zadeh2014-01-011-3/+7
| | |
* | | tweaks to docsReza Zadeh2014-01-011-5/+4
| | |
* | | large scale considerationsReza Zadeh2013-12-271-2/+2
| | |
* | | initial large scale testing beginReza Zadeh2013-12-271-4/+4
| | |
* | | cleanup documentationReza Zadeh2013-12-271-2/+2
| | |
* | | add all testsReza Zadeh2013-12-271-0/+142
| | |
* | | test for truncated svdReza Zadeh2013-12-271-51/+50
| | |
* | | full rank matrix test addedReza Zadeh2013-12-261-1/+9
| | |
* | | Main method added for svdReza Zadeh2013-12-261-4/+4
| | |
* | | new main fileReza Zadeh2013-12-261-10/+19
| | |
* | | Object to hold the svd methodsReza Zadeh2013-12-261-58/+74
| | |
* | | Some documentationReza Zadeh2013-12-261-0/+47
| | |
* | | Initial files - no testsReza Zadeh2013-12-261-0/+68
| |/ |/|