Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Incorporate Tom's comments - update doc and code to reflect that core ↵ | Sandy Ryza | 2014-01-21 | 1 | -2/+1 |
| | | | | requests may not always be honored | ||||
* | SPARK-1033. Ask for cores in Yarn container requests | Sandy Ryza | 2014-01-20 | 1 | -4/+5 |
| | |||||
* | Address comments to fix code formats | Raymond Liu | 2014-01-14 | 4 | -24/+22 |
| | |||||
* | Yarn workerRunnable refactor | Raymond Liu | 2014-01-14 | 3 | -247/+184 |
| | |||||
* | Yarn Client refactor | Raymond Liu | 2014-01-14 | 5 | -709/+450 |
| | |||||
* | Address code review concerns and comments. | Henry Saputra | 2014-01-12 | 2 | -6/+6 |
| | |||||
* | Merge branch 'master' into remove_simpleredundantreturn_scala | Henry Saputra | 2014-01-12 | 6 | -45/+88 |
|\ | |||||
| * | Update based on review comments | Thomas Graves | 2014-01-09 | 4 | -27/+23 |
| | | |||||
| * | add application type | Thomas Graves | 2014-01-09 | 1 | -0/+1 |
| | | |||||
| * | yarn-client addJar fix and misc other | Thomas Graves | 2014-01-09 | 3 | -31/+77 |
| | | |||||
* | | Remove simple redundant return statement for Scala methods/functions: | Henry Saputra | 2014-01-12 | 6 | -20/+21 |
|/ | | | | | | -) Only change simple return statements at the end of method -) Ignore the complex if-else check -) Ignore the ones inside synchronized | ||||
* | Export --file for YarnClient mode to support sending extra files to worker ↵ | Raymond Liu | 2014-01-07 | 1 | -1/+3 |
| | | | | on yarn cluster | ||||
* | Minor typo fix for yarn client | Raymond Liu | 2014-01-07 | 2 | -2/+2 |
| | |||||
* | merge upstream/master | liguoqiang | 2014-01-03 | 22 | -73/+2251 |
|\ | |||||
| * | fix docs for yarn | Raymond Liu | 2014-01-03 | 1 | -2/+2 |
| | | |||||
| * | minor fix for loginfo | Raymond Liu | 2014-01-03 | 1 | -1/+1 |
| | | |||||
| * | move duplicate pom config into parent pom | Raymond Liu | 2014-01-03 | 3 | -179/+84 |
| | | |||||
| * | Using name yarn-alpha/yarn instead of yarn-2.0/yarn-2.2 | Raymond Liu | 2014-01-03 | 14 | -12/+12 |
| | | |||||
| * | Fix yarn/README.md | Raymond Liu | 2014-01-03 | 1 | -6/+4 |
| | | |||||
| * | Clean up unused files for yarn | Raymond Liu | 2014-01-03 | 4 | -311/+0 |
| | | |||||
| * | Fix pom for build yarn/2.x with yarn/common into one jar | Raymond Liu | 2014-01-03 | 3 | -34/+200 |
| | | |||||
| * | merge yarn/scheduler yarn/common code into one directory | Raymond Liu | 2014-01-03 | 3 | -0/+0 |
| | | |||||
| * | Need to send dummy hello message to actually estabilish akka connection. | Raymond Liu | 2014-01-03 | 2 | -0/+4 |
| | | |||||
| * | A few clean up for yarn 2.0 code | Raymond Liu | 2014-01-03 | 2 | -8/+7 |
| | | |||||
| * | Fix yarn/README.md and update docs/running-on-yarn.md | Raymond Liu | 2014-01-03 | 1 | -2/+0 |
| | | |||||
| * | Add README for yarn modules | Raymond Liu | 2014-01-03 | 1 | -0/+16 |
| | | |||||
| * | some code clean up for Yarn 2.2 | Raymond Liu | 2014-01-03 | 2 | -3/+3 |
| | | |||||
| * | Fix pom file for scala binary version | Raymond Liu | 2014-01-03 | 6 | -8/+8 |
| | | |||||
| * | Fix yarn/assemble pom file | Raymond Liu | 2014-01-03 | 2 | -0/+75 |
| | | |||||
| * | Change profile name new-yarn to hadoop2.2-yarn | Raymond Liu | 2014-01-03 | 2 | -2/+2 |
| | | |||||
| * | Fix pom for yarn code reorgnaize commit | Raymond Liu | 2014-01-03 | 6 | -489/+245 |
| | | |||||
| * | Reorganize yarn related codes into sub projects to remove duplicate files. | Raymond Liu | 2014-01-03 | 21 | -18/+2580 |
| | | |||||
* | | Modify spark on yarn to create SparkConf process | liguoqiang | 2014-01-03 | 4 | -27/+36 |
| | | |||||
* | | Modify spark on yarn to create SparkConf process | liguoqiang | 2014-01-03 | 7 | -22/+27 |
|/ | |||||
* | fix yarn-client | Thomas Graves | 2014-01-02 | 1 | -4/+5 |
| | |||||
* | Fix yarn build after sparkConf changes | Thomas Graves | 2014-01-02 | 5 | -56/+48 |
| | |||||
* | Merge remote-tracking branch 'origin/master' into conf2 | Matei Zaharia | 2013-12-29 | 5 | -11/+19 |
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/SparkContext.scala core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala core/src/main/scala/org/apache/spark/scheduler/cluster/ClusterTaskSetManager.scala core/src/main/scala/org/apache/spark/scheduler/local/LocalScheduler.scala core/src/main/scala/org/apache/spark/util/MetadataCleaner.scala core/src/test/scala/org/apache/spark/scheduler/TaskResultGetterSuite.scala core/src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scala new-yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobGenerator.scala streaming/src/test/scala/org/apache/spark/streaming/BasicOperationsSuite.scala streaming/src/test/scala/org/apache/spark/streaming/CheckpointSuite.scala streaming/src/test/scala/org/apache/spark/streaming/InputStreamsSuite.scala streaming/src/test/scala/org/apache/spark/streaming/TestSuiteBase.scala streaming/src/test/scala/org/apache/spark/streaming/WindowOperationsSuite.scala | ||||
| * | Renamed ClusterScheduler to TaskSchedulerImpl for yarn and new-yarn | liguoqiang | 2013-12-26 | 1 | -2/+1 |
| | | |||||
| * | Renamed ClusterScheduler to TaskSchedulerImpl for yarn and new-yarn | liguoqiang | 2013-12-26 | 4 | -8/+11 |
| | | |||||
| * | Merge remote branch 'upstream/master' into consolidate_schedulers | Kay Ousterhout | 2013-12-20 | 4 | -17/+15 |
| |\ | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/scheduler/cluster/ClusterTaskSetManager.scala core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala core/src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scala | ||||
| * \ | Merge master into 127 | Aaron Davidson | 2013-12-08 | 11 | -365/+936 |
| |\ \ | |||||
| * | | | Fixed naming issues and added back ability to specify max task failures. | Kay Ousterhout | 2013-11-13 | 1 | -3/+3 |
| | | | | |||||
| * | | | Merge remote-tracking branch 'upstream/master' into consolidate_schedulers | Kay Ousterhout | 2013-11-13 | 6 | -172/+646 |
| |\ \ \ | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/scheduler/ClusterScheduler.scala | ||||
| * | | | | Deduplicate Local and Cluster schedulers. | Kay Ousterhout | 2013-10-30 | 1 | -3/+7 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The code in LocalScheduler/LocalTaskSetManager was nearly identical to the code in ClusterScheduler/ClusterTaskSetManager. The redundancy made making updating the schedulers unnecessarily painful and error- prone. This commit combines the two into a single TaskScheduler/ TaskSetManager. | ||||
* | | | | | Various fixes to configuration code | Matei Zaharia | 2013-12-28 | 3 | -54/+54 |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Got rid of global SparkContext.globalConf - Pass SparkConf to serializers and compression codecs - Made SparkConf public instead of private[spark] - Improved API of SparkContext and SparkConf - Switched executor environment vars to be passed through SparkConf - Fixed some places that were still using system properties - Fixed some tests, though others are still failing This still fails several tests in core, repl and streaming, likely due to properties not being set or cleared correctly (some of the tests run fine in isolation). | ||||
* | | | | | spark-544, introducing SparkConf and related configuration overhaul. | Prashant Sharma | 2013-12-25 | 6 | -17/+17 |
| |_|_|/ |/| | | | |||||
* | | | | Merge pull request #265 from markhamstra/scala.binary.version | Patrick Wendell | 2013-12-15 | 1 | -4/+4 |
|\ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | DRY out the POMs with scala.binary.version ...instead of hard-coding 2.10 repeatedly. As long as it's not a `<project>`-level `<artifactId>`, I think that we are okay parameterizing these. | ||||
| * | | | | Use scala.binary.version in POMs | Mark Hamstra | 2013-12-15 | 1 | -4/+4 |
| | | | | | |||||
* | | | | | Merge pull request #257 from tgravescs/sparkYarnFixName | Reynold Xin | 2013-12-15 | 1 | -0/+1 |
|\ \ \ \ \ | |/ / / / |/| | | | | | | | | | | | | | | | | | | | Fix the --name option for Spark on Yarn Looks like the --name option accidentally got broken in one of the merges. The Client hangs if the --name option is used right now. | ||||
| * | | | | Fix the --name option for Spark on Yarn | Thomas Graves | 2013-12-12 | 1 | -0/+1 |
| | |_|/ | |/| | |