Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Update SBT build to use simpler fix for Hadoop 0.23.9 | Jey Kottalam | 2013-08-19 | 1 | -11/+2 |
| | |||||
* | Remove redundant dependencies from POMs | Jey Kottalam | 2013-08-18 | 7 | -42/+0 |
| | |||||
* | Fix Maven build with Hadoop 0.23.9 | Jey Kottalam | 2013-08-18 | 2 | -11/+8 |
| | |||||
* | Don't assume spark-examples JAR always exists | Jey Kottalam | 2013-08-18 | 1 | -2/+3 |
| | |||||
* | Make YARN POM file valid | Jey Kottalam | 2013-08-18 | 1 | -28/+33 |
| | |||||
* | Rename YARN build flag to SPARK_WITH_YARN | Jey Kottalam | 2013-08-16 | 2 | -9/+11 |
| | |||||
* | Fix SBT build under Hadoop 0.23.x | Jey Kottalam | 2013-08-16 | 1 | -0/+11 |
| | |||||
* | Updates to repl and example POMs to match SBT build | Jey Kottalam | 2013-08-16 | 3 | -12/+10 |
| | |||||
* | Maven build now also works with YARN | Jey Kottalam | 2013-08-16 | 11 | -403/+237 |
| | |||||
* | Forgot to remove a few references to ${classifier} | Jey Kottalam | 2013-08-16 | 2 | -9/+4 |
| | |||||
* | Don't mark hadoop-client as 'provided' | Jey Kottalam | 2013-08-16 | 4 | -4/+0 |
| | |||||
* | Maven build now works with CDH hadoop-2.0.0-mr1 | Jey Kottalam | 2013-08-16 | 10 | -353/+30 |
| | |||||
* | Initial changes to make Maven build agnostic of hadoop version | Jey Kottalam | 2013-08-16 | 10 | -401/+175 |
| | |||||
* | Fix repl/assembly when YARN enabled | Jey Kottalam | 2013-08-16 | 1 | -3/+4 |
| | |||||
* | Allow make-distribution.sh to specify Hadoop version used | Jey Kottalam | 2013-08-16 | 2 | -17/+64 |
| | |||||
* | Update default version of Hadoop to 1.2.1 | Jey Kottalam | 2013-08-15 | 2 | -2/+2 |
| | |||||
* | Rename HadoopWriter to SparkHadoopWriter since it's outside of our package | Jey Kottalam | 2013-08-15 | 2 | -6/+6 |
| | |||||
* | Fix newTaskAttemptID to work under YARN | Jey Kottalam | 2013-08-15 | 1 | -1/+19 |
| | |||||
* | update YARN docs | Jey Kottalam | 2013-08-15 | 1 | -2/+2 |
| | |||||
* | YARN ApplicationMaster shouldn't wait forever | Jey Kottalam | 2013-08-15 | 1 | -2/+4 |
| | |||||
* | re-enable YARN support | Jey Kottalam | 2013-08-15 | 4 | -25/+26 |
| | |||||
* | SparkEnv isn't available this early, and not needed anyway | Jey Kottalam | 2013-08-15 | 3 | -41/+0 |
| | |||||
* | make SparkHadoopUtil a member of SparkEnv | Jey Kottalam | 2013-08-15 | 9 | -28/+32 |
| | |||||
* | rename HadoopMapRedUtil => SparkHadoopMapRedUtil, HadoopMapReduceUtil => ↵ | Jey Kottalam | 2013-08-15 | 5 | -6/+7 |
| | | | | SparkHadoopMapReduceUtil | ||||
* | yarn support | Jey Kottalam | 2013-08-15 | 3 | -6/+10 |
| | |||||
* | add comment | Jey Kottalam | 2013-08-15 | 1 | -4/+4 |
| | |||||
* | remove hadoop-yarn's org/apache/... | Jey Kottalam | 2013-08-15 | 2 | -60/+0 |
| | |||||
* | yarn sbt | Jey Kottalam | 2013-08-15 | 1 | -13/+15 |
| | |||||
* | dynamically detect hadoop version | Jey Kottalam | 2013-08-15 | 3 | -40/+51 |
| | |||||
* | remove core/src/hadoop{1,2} dirs | Jey Kottalam | 2013-08-15 | 6 | -104/+0 |
| | |||||
* | move yarn to its own directory | Jey Kottalam | 2013-08-15 | 10 | -0/+0 |
| | |||||
* | Merge pull request #829 from JoshRosen/pyspark-unit-tests-python-2.6 | Matei Zaharia | 2013-08-15 | 2 | -19/+20 |
|\ | | | | | Fix PySpark unit tests on Python 2.6 | ||||
| * | Fix PySpark unit tests on Python 2.6. | Josh Rosen | 2013-08-14 | 2 | -19/+20 |
| | | |||||
* | | Merge pull request #833 from rxin/ui | Reynold Xin | 2013-08-15 | 13 | -97/+115 |
|\ \ | | | | | | | Various UI improvements. | ||||
| * | | More minor UI changes including code review feedback. | Reynold Xin | 2013-08-15 | 6 | -16/+39 |
| | | | |||||
| * | | Various UI improvements. | Reynold Xin | 2013-08-14 | 12 | -88/+83 |
|/ / | |||||
* | | Merge pull request #831 from rxin/scheduler | Reynold Xin | 2013-08-14 | 4 | -70/+74 |
|\ \ | | | | | | | A few small scheduler / job description changes. | ||||
| * | | Renamed setCurrentJobDescription to setJobDescription. | Reynold Xin | 2013-08-14 | 1 | -1/+1 |
| | | | |||||
| * | | A few small scheduler / job description changes. | Reynold Xin | 2013-08-14 | 4 | -70/+74 |
|/ / | | | | | | | | | | | | | | | 1. Renamed SparkContext.addLocalProperty to setLocalProperty. And allow this function to unset a property. 2. Renamed SparkContext.setDescription to setCurrentJobDescription. 3. Throw an exception if the fair scheduler allocation file is invalid. | ||||
* | | Merge pull request #822 from pwendell/ui-features | Matei Zaharia | 2013-08-14 | 6 | -27/+54 |
|\ \ | |/ |/| | Adding GC Stats to TaskMetrics (and three small fixes) | ||||
| * | Style cleanup based on Matei feedback | Patrick Wendell | 2013-08-14 | 3 | -5/+4 |
| | | |||||
| * | Small style clean-up | Patrick Wendell | 2013-08-13 | 2 | -2/+2 |
| | | |||||
| * | Correcting terminology in RDD page | Patrick Wendell | 2013-08-13 | 1 | -1/+1 |
| | | |||||
| * | Correct sorting order for stages | Patrick Wendell | 2013-08-13 | 2 | -10/+6 |
| | | |||||
| * | Capturing GC detials in TaskMetrics | Patrick Wendell | 2013-08-13 | 4 | -10/+37 |
| | | |||||
| * | Bug fix for display of shuffle read/write metrics. | Patrick Wendell | 2013-08-13 | 1 | -6/+11 |
| | | | | | | | | | | This fixes an error where empty cells are missing if a given task has no shuffle read/write. | ||||
* | | Merge pull request #826 from kayousterhout/ui_fix | Reynold Xin | 2013-08-14 | 1 | -12/+10 |
|\ \ | | | | | | | Fixed 2 bugs in executor UI (incl. SPARK-877) | ||||
| * | | Fixed 2 bugs in executor UI. | Kay Ousterhout | 2013-08-13 | 1 | -12/+10 |
|/ / | | | | | | | | | | | 1) UI crashed if the executor UI was loaded before any tasks started. 2) The total tasks was incorrectly reported due to using string (rather than int) arithmetic. | ||||
* | | Merge pull request #825 from shivaram/maven-repl-fix | Matei Zaharia | 2013-08-13 | 1 | -0/+30 |
|\ \ | | | | | | | Set SPARK_CLASSPATH for maven repl tests | ||||
| * | | Set SPARK_CLASSPATH for maven repl tests | Shivaram Venkataraman | 2013-08-13 | 1 | -0/+30 |
|/ / |