aboutsummaryrefslogtreecommitdiff
path: root/yarn
Commit message (Collapse)AuthorAgeFilesLines
* Merge remote-tracking branch 'origin/master' into yarn-2.2Harvey Feng2013-11-265-19/+433
|\ | | | | | | | | Conflicts: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala
| * Add YarnClientClusterScheduler and Backend.Raymond Liu2013-11-225-21/+434
| | | | | | | | | | | | | | With this scheduler, the user application is launched locally, While the executor will be launched by YARN on remote nodes. This enables spark-shell to run upon YARN.
* | A few more style fixes in `yarn` package.Harvey Feng2013-11-233-45/+71
| |
* | Merge branch 'master' into yarn-cleanupHarvey Feng2013-11-216-51/+81
|\| | | | | | | | | | | | | | | Conflicts: yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala yarn/src/main/scala/org/apache/spark/deploy/yarn/WorkerRunnable.scala yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocationHandler.scala
| * Merge branch 'master' into removesemicolonscalaHenry Saputra2013-11-193-29/+58
| |\
| | * Impove Spark on Yarn Error handlingtgravescs2013-11-193-29/+58
| | |
| * | Another set of changes to remove unnecessary semicolon (;) from Scala code.Henry Saputra2013-11-194-5/+5
| | | | | | | | | | | | Passed the sbt/sbt compile and test
| * | Remove the semicolons at the end of Scala code to make it more pure Scala code.Henry Saputra2013-11-195-26/+21
| |/ | | | | | | | | | | | | Also remove unused imports as I found them along the way. Remove return statements when returning value in the Scala code. Passing compile and tests.
* / Misc style changes in the 'yarn' package.Harvey Feng2013-11-174-273/+376
|/
* Simple cleanup on Spark's Scala code while testing core and yarn modules:Henry Saputra2013-11-154-8/+6
| | | | | | -) Remove some of unused imports as I found them -) Remove ";" in the imports statements -) Remove () at the end of method call like size that does not have size effect.
* Allow spark on yarn to be run from HDFS. Allows the spark.jar, app.jar, and ↵tgravescs2013-11-046-172/+646
| | | | log4j.properties to be put into hdfs.
* Fix the Worker to use CoarseGrainedExecutorBackend and modify classpath to ↵tgravescs2013-10-212-10/+29
| | | | | | be explicit about inclusion of spark.jar and app.jar
* Fix yarn buildtgravescs2013-10-161-2/+2
|
* Merge remote-tracking branch 'tgravescs/sparkYarnDistCache'Matei Zaharia2013-10-104-45/+253
|\ | | | | | | | | | | | | | | Closes #11 Conflicts: docs/running-on-yarn.md yarn/src/main/scala/org/apache/spark/deploy/yarn/ClientArguments.scala
| * Adding in the --addJars option to make SparkContext.addJar work on yarn and ↵tgravescs2013-10-033-20/+34
| | | | | | | | | | | | cleanup the classpaths
| * Support distributed cache files and archives on spark on yarn and attempt to ↵Y.CORP.YAHOO.COM\tgraves2013-09-234-29/+226
| | | | | | | | cleanup the staging directory on exit
* | Merging build changes in from 0.8Patrick Wendell2013-10-051-3/+3
| |
* | Add default value to usage statementtgravescs2013-10-031-1/+1
| |
* | Allow users to set the application name for Spark on Yarntgravescs2013-10-022-1/+7
| |
* | Update build version in masterPatrick Wendell2013-09-241-1/+1
| |
* | Fix spacing so that the java.io.tmpdir doesn't run on with SPARK_JAVA_OPTSY.CORP.YAHOO.COM\tgraves2013-09-232-4/+6
|/
* Use different Hadoop version for YARN artifacts.Patrick Wendell2013-09-131-0/+5
| | | | | This uses a seperate Hadoop version for YARN artifact. This means when people link against spark-yarn, things will resolve correctly.
* Fix YARN assembly generation under MavenJey Kottalam2013-09-061-33/+28
|
* Review comment changes and update to org.apache packagingY.CORP.YAHOO.COM\tgraves2013-09-037-15/+18
|
* Merge remote-tracking branch 'mesos/master' into yarnUILinkY.CORP.YAHOO.COM\tgraves2013-09-039-29/+29
|\ | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/ui/UIUtils.scala core/src/main/scala/org/apache/spark/ui/jobs/PoolTable.scala core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala docs/running-on-yarn.md
| * Add missing license headers found with RATMatei Zaharia2013-09-021-2/+2
| |
| * Fix some URLsMatei Zaharia2013-09-011-1/+1
| |
| * Initial work to rename package to org.apache.sparkMatei Zaharia2013-09-019-26/+26
| |
* | Link the Spark UI to the Yarn UIY.CORP.YAHOO.COM\tgraves2013-08-303-18/+57
|/
* Merge pull request #865 from tgravescs/fixtmpdirMatei Zaharia2013-08-283-0/+26
|\ | | | | Spark on Yarn should use yarn approved directories for spark.local.dir and tmp
| * Updated based on review comments.Y.CORP.YAHOO.COM\tgraves2013-08-271-9/+6
| |
| * Throw exception if the yarn local dirs isn't setY.CORP.YAHOO.COM\tgraves2013-08-261-1/+5
| |
| * Change to use Yarn appropriate directories rather then /tmp or the user ↵Y.CORP.YAHOO.COM\tgraves2013-08-263-0/+25
| | | | | | | | specified spark.local.dir
* | fix typosY.CORP.YAHOO.COM\tgraves2013-08-261-1/+1
| |
* | Add ability for user to specify environment variablesY.CORP.YAHOO.COM\tgraves2013-08-262-2/+7
|/
* Merge remote-tracking branch 'jey/hadoop-agnostic'Matei Zaharia2013-08-201-7/+0
| | | | | Conflicts: core/src/main/scala/spark/PairRDDFunctions.scala
* Make YARN POM file validJey Kottalam2013-08-181-28/+33
|
* Maven build now also works with YARNJey Kottalam2013-08-161-0/+106
|
* YARN ApplicationMaster shouldn't wait foreverJey Kottalam2013-08-151-2/+4
|
* re-enable YARN supportJey Kottalam2013-08-153-24/+13
|
* SparkEnv isn't available this early, and not needed anywayJey Kottalam2013-08-151-16/+0
|
* remove hadoop-yarn's org/apache/...Jey Kottalam2013-08-152-60/+0
|
* move yarn to its own directoryJey Kottalam2013-08-1510-0/+1864
generated by cgit v1.2.3 (git 2.39.1) at 2024-07-28 21:23:13 +0000