Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Example should make sense | Jey Kottalam | 2013-08-21 | 1 | -5/+5 |
| | |||||
* | Update build docs | Jey Kottalam | 2013-08-21 | 3 | -28/+73 |
| | |||||
* | Allow build configuration to be set in conf/spark-env.sh | Jey Kottalam | 2013-08-21 | 3 | -7/+23 |
| | |||||
* | Use "hadoop.version" property when specifying Hadoop YARN version too | Jey Kottalam | 2013-08-21 | 1 | -6/+6 |
| | |||||
* | Update jekyll plugin to match docs/README.md | Jey Kottalam | 2013-08-21 | 1 | -1/+1 |
| | |||||
* | Change default SPARK_HADOOP_VERSION in make-distribution.sh too | Matei Zaharia | 2013-08-21 | 1 | -1/+1 |
| | |||||
* | Merge branch 'master' of github.com:mesos/spark | Reynold Xin | 2013-08-21 | 1 | -1/+1 |
|\ | |||||
| * | Update docs for Spark UI port | Matei Zaharia | 2013-08-20 | 1 | -1/+1 |
| | | |||||
* | | Downgraded default build hadoop version to 1.0.4. | Reynold Xin | 2013-08-21 | 2 | -2/+2 |
|/ | |||||
* | Merge pull request #851 from markhamstra/MutablePairTE | Reynold Xin | 2013-08-20 | 1 | -1/+1 |
|\ | | | | | Removed meaningless types | ||||
| * | Removed meaningless types | Mark Hamstra | 2013-08-20 | 1 | -1/+1 |
|/ | |||||
* | Merge remote-tracking branch 'jey/hadoop-agnostic' | Matei Zaharia | 2013-08-20 | 45 | -1554/+680 |
|\ | | | | | | | | | Conflicts: core/src/main/scala/spark/PairRDDFunctions.scala | ||||
| * | Update SBT build to use simpler fix for Hadoop 0.23.9 | Jey Kottalam | 2013-08-19 | 1 | -11/+2 |
| | | |||||
| * | Remove redundant dependencies from POMs | Jey Kottalam | 2013-08-18 | 7 | -42/+0 |
| | | |||||
| * | Fix Maven build with Hadoop 0.23.9 | Jey Kottalam | 2013-08-18 | 2 | -11/+8 |
| | | |||||
| * | Don't assume spark-examples JAR always exists | Jey Kottalam | 2013-08-18 | 1 | -2/+3 |
| | | |||||
| * | Make YARN POM file valid | Jey Kottalam | 2013-08-18 | 1 | -28/+33 |
| | | |||||
| * | Rename YARN build flag to SPARK_WITH_YARN | Jey Kottalam | 2013-08-16 | 2 | -9/+11 |
| | | |||||
| * | Fix SBT build under Hadoop 0.23.x | Jey Kottalam | 2013-08-16 | 1 | -0/+11 |
| | | |||||
| * | Updates to repl and example POMs to match SBT build | Jey Kottalam | 2013-08-16 | 3 | -12/+10 |
| | | |||||
| * | Maven build now also works with YARN | Jey Kottalam | 2013-08-16 | 11 | -403/+237 |
| | | |||||
| * | Forgot to remove a few references to ${classifier} | Jey Kottalam | 2013-08-16 | 2 | -9/+4 |
| | | |||||
| * | Don't mark hadoop-client as 'provided' | Jey Kottalam | 2013-08-16 | 4 | -4/+0 |
| | | |||||
| * | Maven build now works with CDH hadoop-2.0.0-mr1 | Jey Kottalam | 2013-08-16 | 10 | -353/+30 |
| | | |||||
| * | Initial changes to make Maven build agnostic of hadoop version | Jey Kottalam | 2013-08-16 | 10 | -401/+175 |
| | | |||||
| * | Fix repl/assembly when YARN enabled | Jey Kottalam | 2013-08-16 | 1 | -3/+4 |
| | | |||||
| * | Allow make-distribution.sh to specify Hadoop version used | Jey Kottalam | 2013-08-16 | 2 | -17/+64 |
| | | |||||
| * | Update default version of Hadoop to 1.2.1 | Jey Kottalam | 2013-08-15 | 2 | -2/+2 |
| | | |||||
| * | Rename HadoopWriter to SparkHadoopWriter since it's outside of our package | Jey Kottalam | 2013-08-15 | 2 | -6/+6 |
| | | |||||
| * | Fix newTaskAttemptID to work under YARN | Jey Kottalam | 2013-08-15 | 1 | -1/+19 |
| | | |||||
| * | update YARN docs | Jey Kottalam | 2013-08-15 | 1 | -2/+2 |
| | | |||||
| * | YARN ApplicationMaster shouldn't wait forever | Jey Kottalam | 2013-08-15 | 1 | -2/+4 |
| | | |||||
| * | re-enable YARN support | Jey Kottalam | 2013-08-15 | 4 | -25/+26 |
| | | |||||
| * | SparkEnv isn't available this early, and not needed anyway | Jey Kottalam | 2013-08-15 | 3 | -41/+0 |
| | | |||||
| * | make SparkHadoopUtil a member of SparkEnv | Jey Kottalam | 2013-08-15 | 9 | -28/+32 |
| | | |||||
| * | rename HadoopMapRedUtil => SparkHadoopMapRedUtil, HadoopMapReduceUtil => ↵ | Jey Kottalam | 2013-08-15 | 5 | -6/+7 |
| | | | | | | | | SparkHadoopMapReduceUtil | ||||
| * | yarn support | Jey Kottalam | 2013-08-15 | 3 | -6/+10 |
| | | |||||
| * | add comment | Jey Kottalam | 2013-08-15 | 1 | -4/+4 |
| | | |||||
| * | remove hadoop-yarn's org/apache/... | Jey Kottalam | 2013-08-15 | 2 | -60/+0 |
| | | |||||
| * | yarn sbt | Jey Kottalam | 2013-08-15 | 1 | -13/+15 |
| | | |||||
| * | dynamically detect hadoop version | Jey Kottalam | 2013-08-15 | 3 | -40/+51 |
| | | |||||
| * | remove core/src/hadoop{1,2} dirs | Jey Kottalam | 2013-08-15 | 6 | -104/+0 |
| | | |||||
| * | move yarn to its own directory | Jey Kottalam | 2013-08-15 | 10 | -0/+0 |
| | | |||||
* | | Merge pull request #844 from markhamstra/priorityRename | Matei Zaharia | 2013-08-20 | 5 | -59/+60 |
|\ \ | | | | | | | Renamed 'priority' to 'jobId' and assorted minor changes | ||||
| * | | changeGeneration --> changeEpoch renaming | Mark Hamstra | 2013-08-20 | 1 | -2/+2 |
| | | | |||||
| * | | Renamed 'priority' to 'jobId' and assorted minor changes | Mark Hamstra | 2013-08-20 | 5 | -59/+60 |
|/ / | |||||
* | | Merge pull request #828 from mateiz/sched-improvements | Matei Zaharia | 2013-08-19 | 42 | -967/+1062 |
|\ \ | | | | | | | Scheduler fixes and improvements | ||||
| * | | Added unit tests for ClusterTaskSetManager, and fix a bug found with | Matei Zaharia | 2013-08-18 | 11 | -28/+396 |
| | | | | | | | | | | | | resetting locality level after a non-local launch | ||||
| * | | Added some comments on threading in scheduler code | Matei Zaharia | 2013-08-18 | 3 | -6/+35 |
| | | | |||||
| * | | Address some review comments: | Matei Zaharia | 2013-08-18 | 7 | -23/+68 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - When a resourceOffers() call has multiple offers, force the TaskSets to consider them in increasing order of locality levels so that they get a chance to launch stuff locally across all offers - Simplify ClusterScheduler.prioritizeContainers - Add docs on the new configuration options |