Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | fixed maven build for scala 2.10 | Prashant Sharma | 2013-09-26 | 1 | -4/+4 |
| | |||||
* | Merge branch 'master' of git://github.com/mesos/spark into scala-2.10 | Prashant Sharma | 2013-09-15 | 3 | -8/+331 |
|\ | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/SparkContext.scala project/SparkBuild.scala | ||||
| * | Small tweaks to MLlib docs | Matei Zaharia | 2013-09-08 | 2 | -8/+9 |
| | | |||||
| * | respose to PR comments | Ameet Talwalkar | 2013-09-08 | 1 | -0/+322 |
| | | |||||
* | | Merged with master | Prashant Sharma | 2013-09-06 | 54 | -909/+3988 |
|\| | |||||
| * | Add missing license headers found with RAT | Matei Zaharia | 2013-09-02 | 2 | -0/+34 |
| | | |||||
| * | Move some classes to more appropriate packages: | Matei Zaharia | 2013-09-01 | 21 | -26/+43 |
| | | | | | | | | | | | | * RDD, *RDDFunctions -> org.apache.spark.rdd * Utils, ClosureCleaner, SizeEstimator -> org.apache.spark.util * JavaSerializer, KryoSerializer -> org.apache.spark.serializer | ||||
| * | Fix some URLs | Matei Zaharia | 2013-09-01 | 1 | -1/+1 |
| | | |||||
| * | Initial work to rename package to org.apache.spark | Matei Zaharia | 2013-09-01 | 40 | -136/+136 |
| | | |||||
| * | Fix broken build by removing addIntercept | Shivaram Venkataraman | 2013-08-30 | 2 | -11/+8 |
| | | |||||
| * | Merge pull request #863 from shivaram/etrain-ridge | Evan Sparks | 2013-08-29 | 12 | -297/+755 |
| |\ | | | | | | | Adding linear regression and refactoring Ridge regression to use SGD | ||||
| | * | Center & scale variables in Ridge, Lasso. | Shivaram Venkataraman | 2013-08-25 | 10 | -228/+347 |
| | | | | | | | | | | | | | | | Also add a unit test that checks if ridge regression lowers cross-validation error. | ||||
| | * | Fixing typos in Java tests, and addressing alignment issues. | Evan Sparks | 2013-08-18 | 4 | -16/+16 |
| | | | |||||
| | * | Centralizing linear data generator and mllib regression tests to use it. | Evan Sparks | 2013-08-18 | 9 | -282/+84 |
| | | | |||||
| | * | Adding Linear Regression, and refactoring Ridge Regression. | Evan Sparks | 2013-08-18 | 8 | -176/+713 |
| | | | |||||
| * | | Merge pull request #819 from shivaram/sgd-cleanup | Evan Sparks | 2013-08-29 | 8 | -48/+160 |
| |\ \ | | | | | | | | | Change SVM to use {0,1} labels | ||||
| | * | | Add an option to turn off data validation, test it. | Shivaram Venkataraman | 2013-08-25 | 5 | -18/+28 |
| | | | | | | | | | | | | | | | | | | | | Also moves addIntercept to have default true to make it similar to validateData option | ||||
| | * | | Specify label format in LogisticRegression. | Shivaram Venkataraman | 2013-08-13 | 1 | -0/+6 |
| | | | | |||||
| | * | | Fix SVM model and unit test to work with {0,1}. | Shivaram Venkataraman | 2013-08-13 | 5 | -12/+18 |
| | | | | | | | | | | | | | | | | Also rename validateFuncs to validators. | ||||
| | * | | Change SVM to use {0,1} labels. | Shivaram Venkataraman | 2013-08-13 | 7 | -26/+116 |
| | |/ | | | | | | | | | | | | | Also add a data validation check to make sure classification labels are always 0 or 1 and add an appropriate test case. | ||||
| * | | Fix code style and a nondeterministic RDD issue in ALS | Matei Zaharia | 2013-08-22 | 1 | -11/+20 |
| | | | |||||
| * | | Merge pull request #814 from holdenk/master | Matei Zaharia | 2013-08-22 | 1 | -7/+14 |
| |\ \ | | | | | | | | | Create less instances of the random class during ALS initialization. | ||||
| | * | | Fix | Holden Karau | 2013-08-15 | 1 | -2/+2 |
| | | | | |||||
| | * | | Code review feedback :) | Holden Karau | 2013-08-12 | 1 | -7/+7 |
| | | | | |||||
| | * | | Use less instances of the random class during ALS setup | Holden Karau | 2013-08-12 | 1 | -7/+14 |
| | |/ | |||||
| * | | Remove redundant dependencies from POMs | Jey Kottalam | 2013-08-18 | 1 | -4/+0 |
| | | | |||||
| * | | Maven build now also works with YARN | Jey Kottalam | 2013-08-16 | 1 | -40/+0 |
| | | | |||||
| * | | Don't mark hadoop-client as 'provided' | Jey Kottalam | 2013-08-16 | 1 | -1/+0 |
| | | | |||||
| * | | Maven build now works with CDH hadoop-2.0.0-mr1 | Jey Kottalam | 2013-08-16 | 1 | -27/+0 |
| | | | |||||
| * | | Initial changes to make Maven build agnostic of hadoop version | Jey Kottalam | 2013-08-16 | 1 | -33/+10 |
| |/ | |||||
| * | Merge pull request #812 from shivaram/maven-mllib-tests | Matei Zaharia | 2013-08-12 | 6 | -7/+32 |
| |\ | | | | | | | Create SparkContext in beforeAll for MLLib tests | ||||
| | * | Create SparkContext in beforeAll for MLLib tests | Shivaram Venkataraman | 2013-08-11 | 6 | -7/+32 |
| | | | | | | | | | | | | This overcomes test failures that occur using Maven | ||||
| * | | Clean up scaladoc in ML Lib. | Shivaram Venkataraman | 2013-08-11 | 17 | -60/+171 |
| |/ | | | | | | | | | Also build and copy ML Lib scaladoc in Spark docs build. Some more minor cleanup with respect to naming, test locations etc. | ||||
| * | Merge pull request #762 from shivaram/sgd-cleanup | Evan Sparks | 2013-08-11 | 21 | -417/+816 |
| |\ | | | | | | | Refactor SGD options into a new class. | ||||
| | * | Fix GLM code review comments and move java tests | Shivaram Venkataraman | 2013-08-10 | 4 | -6/+2 |
| | | | |||||
| | * | Add setters for optimizer, gradient in SGD. | Shivaram Venkataraman | 2013-08-08 | 2 | -8/+19 |
| | | | | | | | | | | | | Also remove java-specific constructor for LabeledPoint. | ||||
| | * | Merge branch 'master' of git://github.com/mesos/spark into sgd-cleanup | Shivaram Venkataraman | 2013-08-06 | 6 | -6/+366 |
| | |\ | | | | | | | | | | | | | | | | | Conflicts: mllib/src/main/scala/spark/mllib/util/MLUtils.scala | ||||
| | * | | Refactor GLM algorithms and add Java tests | Shivaram Venkataraman | 2013-08-06 | 20 | -169/+540 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This change adds Java examples and unit tests for all GLM algorithms to make sure the MLLib interface works from Java. Changes include - Introduce LabeledPoint and avoid using Doubles in train arguments - Rename train to run in class methods - Make the optimizer a member variable of GLM to make sure the builder pattern works | ||||
| | * | | Move implicit arg to constructor for Java access. | Shivaram Venkataraman | 2013-08-03 | 1 | -4/+7 |
| | | | | |||||
| | * | | Refactor optimizers and create GLMs | Shivaram Venkataraman | 2013-08-02 | 10 | -286/+320 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | This change refactors the structure of GLMs to use mixins which maintain a similar interface to other ML lib algorithms. This change also creates an Optimizer trait which allows GLMs to be extended to use other optimization techniques. | ||||
| | * | | Refactor SGD options into a new class. | Shivaram Venkataraman | 2013-07-31 | 8 | -159/+143 |
| | | | | | | | | | | | | | | | | | | | | This refactoring pulls out code shared between SVM, Lasso, LR into a common GradientDescentOpts class. Some style cleanup as well | ||||
| * | | | Merge pull request #786 from shivaram/mllib-java | Matei Zaharia | 2013-08-09 | 6 | -30/+285 |
| |\ \ \ | | | | | | | | | | | Java fixes, tests and examples for ALS, KMeans | ||||
| | * | | | Remove Java-specific constructor for Rating. | Shivaram Venkataraman | 2013-08-08 | 3 | -12/+3 |
| | | | | | | | | | | | | | | | | | | | | | | | | | The scala constructor works for native type java types. Modify examples to match this. | ||||
| | * | | | Add a test case for random initialization. | Shivaram Venkataraman | 2013-08-06 | 2 | -2/+13 |
| | | | | | | | | | | | | | | | | | | | | Also workaround a bug where double[][] class cast fails | ||||
| | * | | | Java examples, tests for KMeans and ALS | Shivaram Venkataraman | 2013-08-06 | 6 | -27/+280 |
| | | |/ | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Changes ALS to accept RDD[Rating] instead of (Int, Int, Double) making it easier to call from Java - Renames class methods from `train` to `run` to enable static methods to be called from Java. - Add unit tests which check if both static / class methods can be called. - Also add examples which port the main() function in ALS, KMeans to the examples project. Couple of minor changes to existing code: - Add a toJavaRDD method in RDD to convert scala RDD to java RDD easily - Workaround a bug where using double[] from Java leads to class cast exception in KMeans init | ||||
| * / | | Fixed a typo in mllib inline documentation. | Reynold Xin | 2013-08-08 | 1 | -1/+1 |
| |/ / | |||||
| * | | fixing formatting, style, and input | Ginger Smith | 2013-08-05 | 1 | -36/+37 |
| | | | |||||
| * | | fixing formatting | Ginger Smith | 2013-08-05 | 1 | -16/+23 |
| | | | |||||
| * | | adding matrix factorization data generator | Ginger Smith | 2013-08-02 | 1 | -0/+105 |
| | | | |||||
| * | | Increase Kryo buffer size in ALS since some arrays become big | Matei Zaharia | 2013-08-02 | 1 | -0/+1 |
| | | |