aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Merge pull request #836 from pwendell/renamePatrick Wendell2013-08-1519-64/+64
|\ | | | | Rename `memoryBytesToString` and `memoryMegabytesToString`
| * Rename `memoryBytesToString` and `memoryMegabytesToString`Patrick Wendell2013-08-1519-64/+64
| | | | | | | | | | | | | | These are used all over the place now and they are not specific to memory at all. memoryBytesToString --> bytesToString memoryMegabytesToString --> megabytesToString
* | Merge pull request #829 from JoshRosen/pyspark-unit-tests-python-2.6Matei Zaharia2013-08-152-19/+20
|\ \ | | | | | | Fix PySpark unit tests on Python 2.6
| * | Fix PySpark unit tests on Python 2.6.Josh Rosen2013-08-142-19/+20
| | |
* | | Merge pull request #833 from rxin/uiReynold Xin2013-08-1513-97/+115
|\ \ \ | | | | | | | | Various UI improvements.
| * | | More minor UI changes including code review feedback.Reynold Xin2013-08-156-16/+39
| | | |
| * | | Various UI improvements.Reynold Xin2013-08-1412-88/+83
|/ / /
* | | Merge pull request #831 from rxin/schedulerReynold Xin2013-08-144-70/+74
|\ \ \ | |_|/ |/| | A few small scheduler / job description changes.
| * | Renamed setCurrentJobDescription to setJobDescription.Reynold Xin2013-08-141-1/+1
| | |
| * | A few small scheduler / job description changes.Reynold Xin2013-08-144-70/+74
|/ / | | | | | | | | | | | | | | 1. Renamed SparkContext.addLocalProperty to setLocalProperty. And allow this function to unset a property. 2. Renamed SparkContext.setDescription to setCurrentJobDescription. 3. Throw an exception if the fair scheduler allocation file is invalid.
* | Merge pull request #822 from pwendell/ui-featuresMatei Zaharia2013-08-146-27/+54
|\ \ | |/ |/| Adding GC Stats to TaskMetrics (and three small fixes)
| * Style cleanup based on Matei feedbackPatrick Wendell2013-08-143-5/+4
| |
| * Small style clean-upPatrick Wendell2013-08-132-2/+2
| |
| * Correcting terminology in RDD pagePatrick Wendell2013-08-131-1/+1
| |
| * Correct sorting order for stagesPatrick Wendell2013-08-132-10/+6
| |
| * Capturing GC detials in TaskMetricsPatrick Wendell2013-08-134-10/+37
| |
| * Bug fix for display of shuffle read/write metrics.Patrick Wendell2013-08-131-6/+11
| | | | | | | | | | This fixes an error where empty cells are missing if a given task has no shuffle read/write.
* | Merge pull request #826 from kayousterhout/ui_fixReynold Xin2013-08-141-12/+10
|\ \ | | | | | | Fixed 2 bugs in executor UI (incl. SPARK-877)
| * | Fixed 2 bugs in executor UI.Kay Ousterhout2013-08-131-12/+10
|/ / | | | | | | | | | | 1) UI crashed if the executor UI was loaded before any tasks started. 2) The total tasks was incorrectly reported due to using string (rather than int) arithmetic.
* | Merge pull request #825 from shivaram/maven-repl-fixMatei Zaharia2013-08-131-0/+30
|\ \ | | | | | | Set SPARK_CLASSPATH for maven repl tests
| * | Set SPARK_CLASSPATH for maven repl testsShivaram Venkataraman2013-08-131-0/+30
|/ /
* | Merge pull request #824 from mateiz/mesos-0.12.1Matei Zaharia2013-08-132-2/+2
|\ \ | | | | | | Update to Mesos 0.12.1
| * | Update to Mesos 0.12.1Matei Zaharia2013-08-132-2/+2
|/ /
* | Merge pull request #821 from pwendell/print-launch-commandMatei Zaharia2013-08-131-1/+1
|\ \ | | | | | | Print run command to stderr rather than stdout
| * | Print run command to stderr rather than stdoutPatrick Wendell2013-08-131-1/+1
| | |
* | | Merge pull request #818 from kayousterhout/killed_fixMatei Zaharia2013-08-131-1/+3
|\ \ \ | |_|/ |/| | Properly account for killed tasks.
| * | Reuse the set of failed states rather than creating a new object each timeKay Ousterhout2013-08-131-1/+3
| | |
| * | Properly account for killed tasks.Kay Ousterhout2013-08-131-1/+1
|/ / | | | | | | | | | | | | The TaskState class's isFinished() method didn't return true for KILLED tasks, which means some resources are never reclaimed for tasks that are killed. This also made it inconsistent with the isFinished() method used by CoarseMesosSchedulerBackend.
* | Merge pull request #817 from pwendell/pr_784Patrick Wendell2013-08-135-9/+10
|\ \ | | | | | | Minor clean-up in metrics servlet code
| * | Slight change to pr-784Patrick Wendell2013-08-135-9/+10
|/ /
* | Merge pull request #784 from jerryshao/dev-metrics-servletPatrick Wendell2013-08-1317-41/+175
|\ \ | | | | | | Add MetricsServlet for Spark metrics system
| * | MetricsServlet code refactor according to commentsjerryshao2013-08-1212-52/+39
| | |
| * | Add MetricsServlet for Spark metrics systemjerryshao2013-08-1215-34/+181
| | |
* | | Merge pull request #802 from stayhf/SPARK-760-PythonMatei Zaharia2013-08-121-0/+70
|\ \ \ | | | | | | | | Simple PageRank algorithm implementation in Python for SPARK-760
| * | | Code update for Matei's suggestionsstayhf2013-08-111-7/+9
| | | |
| * | | Simple PageRank algorithm implementation in Python for SPARK-760stayhf2013-08-101-0/+68
| | | |
* | | | Merge pull request #813 from AndreSchumacher/add_files_pysparkMatei Zaharia2013-08-121-1/+6
|\ \ \ \ | | | | | | | | | | Implementing SPARK-865: Add the equivalent of ADD_JARS to PySpark
| * | | | Implementing SPARK-865: Add the equivalent of ADD_JARS to PySparkAndre Schumacher2013-08-121-1/+6
| | | | | | | | | | | | | | | | | | | | Now ADD_FILES uses a comma as file name separator.
* | | | | Merge pull request #812 from shivaram/maven-mllib-testsMatei Zaharia2013-08-126-7/+32
|\ \ \ \ \ | | | | | | | | | | | | Create SparkContext in beforeAll for MLLib tests
| * | | | | Create SparkContext in beforeAll for MLLib testsShivaram Venkataraman2013-08-116-7/+32
| | | | | | | | | | | | | | | | | | | | | | | | This overcomes test failures that occur using Maven
* | | | | | Merge pull request #807 from JoshRosen/guava-optionalMatei Zaharia2013-08-127-37/+108
|\ \ \ \ \ \ | | | | | | | | | | | | | | Change scala.Option to Guava Optional in Java APIs
| * | | | | | Fix import organization.Josh Rosen2013-08-121-2/+1
| | | | | | |
| * | | | | | Change scala.Option to Guava Optional in Java APIs.Josh Rosen2013-08-117-37/+109
| | | | | | |
* | | | | | | Merge pull request #809 from shivaram/sgd-cleanupEvan Sparks2013-08-1219-61/+173
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | Clean up scaladoc in ML Lib.
| * | | | | | | Add ML Lib scaladoc to API dropdownShivaram Venkataraman2013-08-111-0/+1
| | | | | | | |
| * | | | | | | Clean up scaladoc in ML Lib.Shivaram Venkataraman2013-08-1118-61/+172
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Also build and copy ML Lib scaladoc in Spark docs build. Some more minor cleanup with respect to naming, test locations etc.
* | | | | | | | Merge pull request #806 from apivovarov/yarn-205Matei Zaharia2013-08-121-1/+1
|\ \ \ \ \ \ \ \ | |_|_|_|_|_|/ / |/| | | | | | | Changed yarn.version to 2.0.5 in pom.xml
| * | | | | | | Changed yarn.version to 2.0.5 in pom.xmlAlexander Pivovarov2013-08-101-1/+1
| | | | | | | |
* | | | | | | | Merge pull request #810 from pwendell/dead_doc_codeReynold Xin2013-08-111-41/+0
|\ \ \ \ \ \ \ \ | |_|/ / / / / / |/| | | | | | | Remove now dead code inside of docs
| * | | | | | | Removing dead docsPatrick Wendell2013-08-111-41/+0
|/ / / / / / /