aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Allow make-distribution.sh to specify Hadoop version usedJey Kottalam2013-08-162-17/+64
|
* Update default version of Hadoop to 1.2.1Jey Kottalam2013-08-152-2/+2
|
* Rename HadoopWriter to SparkHadoopWriter since it's outside of our packageJey Kottalam2013-08-152-6/+6
|
* Fix newTaskAttemptID to work under YARNJey Kottalam2013-08-151-1/+19
|
* update YARN docsJey Kottalam2013-08-151-2/+2
|
* YARN ApplicationMaster shouldn't wait foreverJey Kottalam2013-08-151-2/+4
|
* re-enable YARN supportJey Kottalam2013-08-154-25/+26
|
* SparkEnv isn't available this early, and not needed anywayJey Kottalam2013-08-153-41/+0
|
* make SparkHadoopUtil a member of SparkEnvJey Kottalam2013-08-159-28/+32
|
* rename HadoopMapRedUtil => SparkHadoopMapRedUtil, HadoopMapReduceUtil => ↵Jey Kottalam2013-08-155-6/+7
| | | | SparkHadoopMapReduceUtil
* yarn supportJey Kottalam2013-08-153-6/+10
|
* add commentJey Kottalam2013-08-151-4/+4
|
* remove hadoop-yarn's org/apache/...Jey Kottalam2013-08-152-60/+0
|
* yarn sbtJey Kottalam2013-08-151-13/+15
|
* dynamically detect hadoop versionJey Kottalam2013-08-153-40/+51
|
* remove core/src/hadoop{1,2} dirsJey Kottalam2013-08-156-104/+0
|
* move yarn to its own directoryJey Kottalam2013-08-1510-0/+0
|
* Merge pull request #829 from JoshRosen/pyspark-unit-tests-python-2.6Matei Zaharia2013-08-152-19/+20
|\ | | | | Fix PySpark unit tests on Python 2.6
| * Fix PySpark unit tests on Python 2.6.Josh Rosen2013-08-142-19/+20
| |
* | Merge pull request #833 from rxin/uiReynold Xin2013-08-1513-97/+115
|\ \ | | | | | | Various UI improvements.
| * | More minor UI changes including code review feedback.Reynold Xin2013-08-156-16/+39
| | |
| * | Various UI improvements.Reynold Xin2013-08-1412-88/+83
|/ /
* | Merge pull request #831 from rxin/schedulerReynold Xin2013-08-144-70/+74
|\ \ | | | | | | A few small scheduler / job description changes.
| * | Renamed setCurrentJobDescription to setJobDescription.Reynold Xin2013-08-141-1/+1
| | |
| * | A few small scheduler / job description changes.Reynold Xin2013-08-144-70/+74
|/ / | | | | | | | | | | | | | | 1. Renamed SparkContext.addLocalProperty to setLocalProperty. And allow this function to unset a property. 2. Renamed SparkContext.setDescription to setCurrentJobDescription. 3. Throw an exception if the fair scheduler allocation file is invalid.
* | Merge pull request #822 from pwendell/ui-featuresMatei Zaharia2013-08-146-27/+54
|\ \ | |/ |/| Adding GC Stats to TaskMetrics (and three small fixes)
| * Style cleanup based on Matei feedbackPatrick Wendell2013-08-143-5/+4
| |
| * Small style clean-upPatrick Wendell2013-08-132-2/+2
| |
| * Correcting terminology in RDD pagePatrick Wendell2013-08-131-1/+1
| |
| * Correct sorting order for stagesPatrick Wendell2013-08-132-10/+6
| |
| * Capturing GC detials in TaskMetricsPatrick Wendell2013-08-134-10/+37
| |
| * Bug fix for display of shuffle read/write metrics.Patrick Wendell2013-08-131-6/+11
| | | | | | | | | | This fixes an error where empty cells are missing if a given task has no shuffle read/write.
* | Merge pull request #826 from kayousterhout/ui_fixReynold Xin2013-08-141-12/+10
|\ \ | | | | | | Fixed 2 bugs in executor UI (incl. SPARK-877)
| * | Fixed 2 bugs in executor UI.Kay Ousterhout2013-08-131-12/+10
|/ / | | | | | | | | | | 1) UI crashed if the executor UI was loaded before any tasks started. 2) The total tasks was incorrectly reported due to using string (rather than int) arithmetic.
* | Merge pull request #825 from shivaram/maven-repl-fixMatei Zaharia2013-08-131-0/+30
|\ \ | | | | | | Set SPARK_CLASSPATH for maven repl tests
| * | Set SPARK_CLASSPATH for maven repl testsShivaram Venkataraman2013-08-131-0/+30
|/ /
* | Merge pull request #824 from mateiz/mesos-0.12.1Matei Zaharia2013-08-132-2/+2
|\ \ | | | | | | Update to Mesos 0.12.1
| * | Update to Mesos 0.12.1Matei Zaharia2013-08-132-2/+2
|/ /
* | Merge pull request #821 from pwendell/print-launch-commandMatei Zaharia2013-08-131-1/+1
|\ \ | | | | | | Print run command to stderr rather than stdout
| * | Print run command to stderr rather than stdoutPatrick Wendell2013-08-131-1/+1
| | |
* | | Merge pull request #818 from kayousterhout/killed_fixMatei Zaharia2013-08-131-1/+3
|\ \ \ | |_|/ |/| | Properly account for killed tasks.
| * | Reuse the set of failed states rather than creating a new object each timeKay Ousterhout2013-08-131-1/+3
| | |
| * | Properly account for killed tasks.Kay Ousterhout2013-08-131-1/+1
|/ / | | | | | | | | | | | | The TaskState class's isFinished() method didn't return true for KILLED tasks, which means some resources are never reclaimed for tasks that are killed. This also made it inconsistent with the isFinished() method used by CoarseMesosSchedulerBackend.
* | Merge pull request #817 from pwendell/pr_784Patrick Wendell2013-08-135-9/+10
|\ \ | | | | | | Minor clean-up in metrics servlet code
| * | Slight change to pr-784Patrick Wendell2013-08-135-9/+10
|/ /
* | Merge pull request #784 from jerryshao/dev-metrics-servletPatrick Wendell2013-08-1317-41/+175
|\ \ | | | | | | Add MetricsServlet for Spark metrics system
| * | MetricsServlet code refactor according to commentsjerryshao2013-08-1212-52/+39
| | |
| * | Add MetricsServlet for Spark metrics systemjerryshao2013-08-1215-34/+181
| | |
* | | Merge pull request #802 from stayhf/SPARK-760-PythonMatei Zaharia2013-08-121-0/+70
|\ \ \ | | | | | | | | Simple PageRank algorithm implementation in Python for SPARK-760
| * | | Code update for Matei's suggestionsstayhf2013-08-111-7/+9
| | | |
generated by cgit v1.2.3 (git 2.39.1) at 2024-09-19 05:07:10 +0000