Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Centralizing linear data generator and mllib regression tests to use it. | Evan Sparks | 2013-08-18 | 9 | -282/+84 |
| | |||||
* | Adding Linear Regression, and refactoring Ridge Regression. | Evan Sparks | 2013-08-18 | 8 | -176/+713 |
| | |||||
* | Merge pull request #831 from rxin/scheduler | Reynold Xin | 2013-08-14 | 4 | -70/+74 |
|\ | | | | | A few small scheduler / job description changes. | ||||
| * | Renamed setCurrentJobDescription to setJobDescription. | Reynold Xin | 2013-08-14 | 1 | -1/+1 |
| | | |||||
| * | A few small scheduler / job description changes. | Reynold Xin | 2013-08-14 | 4 | -70/+74 |
|/ | | | | | | | | 1. Renamed SparkContext.addLocalProperty to setLocalProperty. And allow this function to unset a property. 2. Renamed SparkContext.setDescription to setCurrentJobDescription. 3. Throw an exception if the fair scheduler allocation file is invalid. | ||||
* | Merge pull request #822 from pwendell/ui-features | Matei Zaharia | 2013-08-14 | 6 | -27/+54 |
|\ | | | | | Adding GC Stats to TaskMetrics (and three small fixes) | ||||
| * | Style cleanup based on Matei feedback | Patrick Wendell | 2013-08-14 | 3 | -5/+4 |
| | | |||||
| * | Small style clean-up | Patrick Wendell | 2013-08-13 | 2 | -2/+2 |
| | | |||||
| * | Correcting terminology in RDD page | Patrick Wendell | 2013-08-13 | 1 | -1/+1 |
| | | |||||
| * | Correct sorting order for stages | Patrick Wendell | 2013-08-13 | 2 | -10/+6 |
| | | |||||
| * | Capturing GC detials in TaskMetrics | Patrick Wendell | 2013-08-13 | 4 | -10/+37 |
| | | |||||
| * | Bug fix for display of shuffle read/write metrics. | Patrick Wendell | 2013-08-13 | 1 | -6/+11 |
| | | | | | | | | | | This fixes an error where empty cells are missing if a given task has no shuffle read/write. | ||||
* | | Merge pull request #826 from kayousterhout/ui_fix | Reynold Xin | 2013-08-14 | 1 | -12/+10 |
|\ \ | | | | | | | Fixed 2 bugs in executor UI (incl. SPARK-877) | ||||
| * | | Fixed 2 bugs in executor UI. | Kay Ousterhout | 2013-08-13 | 1 | -12/+10 |
|/ / | | | | | | | | | | | 1) UI crashed if the executor UI was loaded before any tasks started. 2) The total tasks was incorrectly reported due to using string (rather than int) arithmetic. | ||||
* | | Merge pull request #825 from shivaram/maven-repl-fix | Matei Zaharia | 2013-08-13 | 1 | -0/+30 |
|\ \ | | | | | | | Set SPARK_CLASSPATH for maven repl tests | ||||
| * | | Set SPARK_CLASSPATH for maven repl tests | Shivaram Venkataraman | 2013-08-13 | 1 | -0/+30 |
|/ / | |||||
* | | Merge pull request #824 from mateiz/mesos-0.12.1 | Matei Zaharia | 2013-08-13 | 2 | -2/+2 |
|\ \ | | | | | | | Update to Mesos 0.12.1 | ||||
| * | | Update to Mesos 0.12.1 | Matei Zaharia | 2013-08-13 | 2 | -2/+2 |
|/ / | |||||
* | | Merge pull request #821 from pwendell/print-launch-command | Matei Zaharia | 2013-08-13 | 1 | -1/+1 |
|\ \ | | | | | | | Print run command to stderr rather than stdout | ||||
| * | | Print run command to stderr rather than stdout | Patrick Wendell | 2013-08-13 | 1 | -1/+1 |
| | | | |||||
* | | | Merge pull request #818 from kayousterhout/killed_fix | Matei Zaharia | 2013-08-13 | 1 | -1/+3 |
|\ \ \ | |_|/ |/| | | Properly account for killed tasks. | ||||
| * | | Reuse the set of failed states rather than creating a new object each time | Kay Ousterhout | 2013-08-13 | 1 | -1/+3 |
| | | | |||||
| * | | Properly account for killed tasks. | Kay Ousterhout | 2013-08-13 | 1 | -1/+1 |
|/ / | | | | | | | | | | | | | The TaskState class's isFinished() method didn't return true for KILLED tasks, which means some resources are never reclaimed for tasks that are killed. This also made it inconsistent with the isFinished() method used by CoarseMesosSchedulerBackend. | ||||
* | | Merge pull request #817 from pwendell/pr_784 | Patrick Wendell | 2013-08-13 | 5 | -9/+10 |
|\ \ | | | | | | | Minor clean-up in metrics servlet code | ||||
| * | | Slight change to pr-784 | Patrick Wendell | 2013-08-13 | 5 | -9/+10 |
|/ / | |||||
* | | Merge pull request #784 from jerryshao/dev-metrics-servlet | Patrick Wendell | 2013-08-13 | 17 | -41/+175 |
|\ \ | | | | | | | Add MetricsServlet for Spark metrics system | ||||
| * | | MetricsServlet code refactor according to comments | jerryshao | 2013-08-12 | 12 | -52/+39 |
| | | | |||||
| * | | Add MetricsServlet for Spark metrics system | jerryshao | 2013-08-12 | 15 | -34/+181 |
| | | | |||||
* | | | Merge pull request #802 from stayhf/SPARK-760-Python | Matei Zaharia | 2013-08-12 | 1 | -0/+70 |
|\ \ \ | | | | | | | | | Simple PageRank algorithm implementation in Python for SPARK-760 | ||||
| * | | | Code update for Matei's suggestions | stayhf | 2013-08-11 | 1 | -7/+9 |
| | | | | |||||
| * | | | Simple PageRank algorithm implementation in Python for SPARK-760 | stayhf | 2013-08-10 | 1 | -0/+68 |
| | | | | |||||
* | | | | Merge pull request #813 from AndreSchumacher/add_files_pyspark | Matei Zaharia | 2013-08-12 | 1 | -1/+6 |
|\ \ \ \ | | | | | | | | | | | Implementing SPARK-865: Add the equivalent of ADD_JARS to PySpark | ||||
| * | | | | Implementing SPARK-865: Add the equivalent of ADD_JARS to PySpark | Andre Schumacher | 2013-08-12 | 1 | -1/+6 |
| | | | | | | | | | | | | | | | | | | | | Now ADD_FILES uses a comma as file name separator. | ||||
* | | | | | Merge pull request #812 from shivaram/maven-mllib-tests | Matei Zaharia | 2013-08-12 | 6 | -7/+32 |
|\ \ \ \ \ | | | | | | | | | | | | | Create SparkContext in beforeAll for MLLib tests | ||||
| * | | | | | Create SparkContext in beforeAll for MLLib tests | Shivaram Venkataraman | 2013-08-11 | 6 | -7/+32 |
| | | | | | | | | | | | | | | | | | | | | | | | | This overcomes test failures that occur using Maven | ||||
* | | | | | | Merge pull request #807 from JoshRosen/guava-optional | Matei Zaharia | 2013-08-12 | 7 | -37/+108 |
|\ \ \ \ \ \ | | | | | | | | | | | | | | | Change scala.Option to Guava Optional in Java APIs | ||||
| * | | | | | | Fix import organization. | Josh Rosen | 2013-08-12 | 1 | -2/+1 |
| | | | | | | | |||||
| * | | | | | | Change scala.Option to Guava Optional in Java APIs. | Josh Rosen | 2013-08-11 | 7 | -37/+109 |
| | | | | | | | |||||
* | | | | | | | Merge pull request #809 from shivaram/sgd-cleanup | Evan Sparks | 2013-08-12 | 19 | -61/+173 |
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | Clean up scaladoc in ML Lib. | ||||
| * | | | | | | | Add ML Lib scaladoc to API dropdown | Shivaram Venkataraman | 2013-08-11 | 1 | -0/+1 |
| | | | | | | | | |||||
| * | | | | | | | Clean up scaladoc in ML Lib. | Shivaram Venkataraman | 2013-08-11 | 18 | -61/+172 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Also build and copy ML Lib scaladoc in Spark docs build. Some more minor cleanup with respect to naming, test locations etc. | ||||
* | | | | | | | | Merge pull request #806 from apivovarov/yarn-205 | Matei Zaharia | 2013-08-12 | 1 | -1/+1 |
|\ \ \ \ \ \ \ \ | |_|_|_|_|_|/ / |/| | | | | | | | Changed yarn.version to 2.0.5 in pom.xml | ||||
| * | | | | | | | Changed yarn.version to 2.0.5 in pom.xml | Alexander Pivovarov | 2013-08-10 | 1 | -1/+1 |
| | | | | | | | | |||||
* | | | | | | | | Merge pull request #810 from pwendell/dead_doc_code | Reynold Xin | 2013-08-11 | 1 | -41/+0 |
|\ \ \ \ \ \ \ \ | |_|/ / / / / / |/| | | | | | | | Remove now dead code inside of docs | ||||
| * | | | | | | | Removing dead docs | Patrick Wendell | 2013-08-11 | 1 | -41/+0 |
|/ / / / / / / | |||||
* | | | | | | | Merge pull request #808 from pwendell/ui_compressed_bytes | Reynold Xin | 2013-08-11 | 1 | -1/+2 |
|\ \ \ \ \ \ \ | |_|_|/ / / / |/| | | | | | | Report compressed bytes read when calculating TaskMetrics | ||||
| * | | | | | | Report compressed bytes read when calculating TaskMetrics | Patrick Wendell | 2013-08-11 | 1 | -1/+2 |
| | | | | | | | |||||
* | | | | | | | Merge pull request #805 from woggle/hadoop-rdd-jobconf | Matei Zaharia | 2013-08-11 | 1 | -2/+2 |
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | Use new Configuration() instead of slower new JobConf() in SerializableWritable | ||||
| * | | | | | | | Use new Configuration() instead of new JobConf() for ObjectWritable. | Charles Reiss | 2013-08-10 | 1 | -2/+2 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | JobConf's constructor loads default config files in some verisons of Hadoop, which is quite slow, and we only need the Configuration object to pass the correct ClassLoader. | ||||
* | | | | | | | | Merge pull request #762 from shivaram/sgd-cleanup | Evan Sparks | 2013-08-11 | 22 | -417/+901 |
|\ \ \ \ \ \ \ \ | |_|_|_|/ / / / |/| | | | | | | | Refactor SGD options into a new class. |