aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Example should make senseJey Kottalam2013-08-211-5/+5
|
* Update build docsJey Kottalam2013-08-213-28/+73
|
* Allow build configuration to be set in conf/spark-env.shJey Kottalam2013-08-213-7/+23
|
* Use "hadoop.version" property when specifying Hadoop YARN version tooJey Kottalam2013-08-211-6/+6
|
* Update jekyll plugin to match docs/README.mdJey Kottalam2013-08-211-1/+1
|
* Change default SPARK_HADOOP_VERSION in make-distribution.sh tooMatei Zaharia2013-08-211-1/+1
|
* Merge branch 'master' of github.com:mesos/sparkReynold Xin2013-08-211-1/+1
|\
| * Update docs for Spark UI portMatei Zaharia2013-08-201-1/+1
| |
* | Downgraded default build hadoop version to 1.0.4.Reynold Xin2013-08-212-2/+2
|/
* Merge pull request #851 from markhamstra/MutablePairTEReynold Xin2013-08-201-1/+1
|\ | | | | Removed meaningless types
| * Removed meaningless typesMark Hamstra2013-08-201-1/+1
|/
* Merge remote-tracking branch 'jey/hadoop-agnostic'Matei Zaharia2013-08-2045-1554/+680
|\ | | | | | | | | Conflicts: core/src/main/scala/spark/PairRDDFunctions.scala
| * Update SBT build to use simpler fix for Hadoop 0.23.9Jey Kottalam2013-08-191-11/+2
| |
| * Remove redundant dependencies from POMsJey Kottalam2013-08-187-42/+0
| |
| * Fix Maven build with Hadoop 0.23.9Jey Kottalam2013-08-182-11/+8
| |
| * Don't assume spark-examples JAR always existsJey Kottalam2013-08-181-2/+3
| |
| * Make YARN POM file validJey Kottalam2013-08-181-28/+33
| |
| * Rename YARN build flag to SPARK_WITH_YARNJey Kottalam2013-08-162-9/+11
| |
| * Fix SBT build under Hadoop 0.23.xJey Kottalam2013-08-161-0/+11
| |
| * Updates to repl and example POMs to match SBT buildJey Kottalam2013-08-163-12/+10
| |
| * Maven build now also works with YARNJey Kottalam2013-08-1611-403/+237
| |
| * Forgot to remove a few references to ${classifier}Jey Kottalam2013-08-162-9/+4
| |
| * Don't mark hadoop-client as 'provided'Jey Kottalam2013-08-164-4/+0
| |
| * Maven build now works with CDH hadoop-2.0.0-mr1Jey Kottalam2013-08-1610-353/+30
| |
| * Initial changes to make Maven build agnostic of hadoop versionJey Kottalam2013-08-1610-401/+175
| |
| * Fix repl/assembly when YARN enabledJey Kottalam2013-08-161-3/+4
| |
| * Allow make-distribution.sh to specify Hadoop version usedJey Kottalam2013-08-162-17/+64
| |
| * Update default version of Hadoop to 1.2.1Jey Kottalam2013-08-152-2/+2
| |
| * Rename HadoopWriter to SparkHadoopWriter since it's outside of our packageJey Kottalam2013-08-152-6/+6
| |
| * Fix newTaskAttemptID to work under YARNJey Kottalam2013-08-151-1/+19
| |
| * update YARN docsJey Kottalam2013-08-151-2/+2
| |
| * YARN ApplicationMaster shouldn't wait foreverJey Kottalam2013-08-151-2/+4
| |
| * re-enable YARN supportJey Kottalam2013-08-154-25/+26
| |
| * SparkEnv isn't available this early, and not needed anywayJey Kottalam2013-08-153-41/+0
| |
| * make SparkHadoopUtil a member of SparkEnvJey Kottalam2013-08-159-28/+32
| |
| * rename HadoopMapRedUtil => SparkHadoopMapRedUtil, HadoopMapReduceUtil => ↵Jey Kottalam2013-08-155-6/+7
| | | | | | | | SparkHadoopMapReduceUtil
| * yarn supportJey Kottalam2013-08-153-6/+10
| |
| * add commentJey Kottalam2013-08-151-4/+4
| |
| * remove hadoop-yarn's org/apache/...Jey Kottalam2013-08-152-60/+0
| |
| * yarn sbtJey Kottalam2013-08-151-13/+15
| |
| * dynamically detect hadoop versionJey Kottalam2013-08-153-40/+51
| |
| * remove core/src/hadoop{1,2} dirsJey Kottalam2013-08-156-104/+0
| |
| * move yarn to its own directoryJey Kottalam2013-08-1510-0/+0
| |
* | Merge pull request #844 from markhamstra/priorityRenameMatei Zaharia2013-08-205-59/+60
|\ \ | | | | | | Renamed 'priority' to 'jobId' and assorted minor changes
| * | changeGeneration --> changeEpoch renamingMark Hamstra2013-08-201-2/+2
| | |
| * | Renamed 'priority' to 'jobId' and assorted minor changesMark Hamstra2013-08-205-59/+60
|/ /
* | Merge pull request #828 from mateiz/sched-improvementsMatei Zaharia2013-08-1942-967/+1062
|\ \ | | | | | | Scheduler fixes and improvements
| * | Added unit tests for ClusterTaskSetManager, and fix a bug found withMatei Zaharia2013-08-1811-28/+396
| | | | | | | | | | | | resetting locality level after a non-local launch
| * | Added some comments on threading in scheduler codeMatei Zaharia2013-08-183-6/+35
| | |
| * | Address some review comments:Matei Zaharia2013-08-187-23/+68
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - When a resourceOffers() call has multiple offers, force the TaskSets to consider them in increasing order of locality levels so that they get a chance to launch stuff locally across all offers - Simplify ClusterScheduler.prioritizeContainers - Add docs on the new configuration options