aboutsummaryrefslogtreecommitdiff
path: root/docs
Commit message (Collapse)AuthorAgeFilesLines
* Merge pull request #317 from ScrapCodes/spark-915-segregate-scriptsPatrick Wendell2014-01-0311-52/+52
|\ | | | | | | Spark-915 segregate scripts
| * sbin/spark-class* -> bin/spark-class*Prashant Sharma2014-01-032-3/+3
| |
| * a few left over document changePrashant Sharma2014-01-021-1/+1
| |
| * pyspark -> bin/pysparkPrashant Sharma2014-01-023-17/+17
| |
| * run-example -> bin/run-examplePrashant Sharma2014-01-026-12/+12
| |
| * spark-shell -> bin/spark-shellPrashant Sharma2014-01-027-13/+13
| |
| * Merge branch 'scripts-reorg' of github.com:shane-huang/incubator-spark into ↵Prashant Sharma2014-01-022-9/+9
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | spark-915-segregate-scripts Conflicts: bin/spark-shell core/pom.xml core/src/main/scala/org/apache/spark/SparkContext.scala core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala core/src/main/scala/org/apache/spark/ui/UIWorkloadGenerator.scala core/src/test/scala/org/apache/spark/DriverSuite.scala python/run-tests sbin/compute-classpath.sh sbin/spark-class sbin/stop-slaves.sh
| | * Merge branch 'reorgscripts' into scripts-reorgshane-huang2013-09-272-9/+9
| | |\
| | | * add admin scripts to sbinshane-huang2013-09-231-6/+6
| | | | | | | | | | | | | | | | Signed-off-by: shane-huang <shengsheng.huang@intel.com>
| | | * added spark-class and spark-executor to sbinshane-huang2013-09-232-3/+3
| | | | | | | | | | | | | | | | Signed-off-by: shane-huang <shengsheng.huang@intel.com>
* | | | fix docs for yarnRaymond Liu2014-01-031-3/+0
| | | |
* | | | Using name yarn-alpha/yarn instead of yarn-2.0/yarn-2.2Raymond Liu2014-01-031-4/+4
| | | |
* | | | Update maven build documentationRaymond Liu2014-01-032-8/+4
| | | |
* | | | Fix yarn/README.md and update docs/running-on-yarn.mdRaymond Liu2014-01-031-1/+1
|/ / /
* | | Updated docs for SparkConf and handled review commentsMatei Zaharia2013-12-3012-75/+154
| | |
* | | changed the example links in the scala-programming-guidfengdong2013-12-181-1/+1
| | |
* | | Fixed the example link.fengdong2013-12-181-1/+1
| | |
* | | Merge pull request #251 from pwendell/masterReynold Xin2013-12-141-5/+7
|\ \ \ | | | | | | | | | | | | | | | | | | | | Fix list rendering in YARN markdown docs. This is some minor clean-up which makes the list render correctly.
| * | | Fix list rendering in YARN markdown docs.Patrick Wendell2013-12-101-5/+7
| | | |
* | | | A few corrections to documentation.Prashant Sharma2013-12-121-7/+7
| | | |
* | | | Merge branch 'master' into akka-bug-fixPrashant Sharma2013-12-1111-18/+69
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/pom.xml core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala pom.xml project/SparkBuild.scala streaming/pom.xml yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocationHandler.scala
| * | | Small fixPatrick Wendell2013-12-071-1/+1
| | | |
| * | | Adding HDP 2.0 versionPatrick Wendell2013-12-071-1/+2
| | | |
| * | | Various broken links in documentationPatrick Wendell2013-12-076-10/+10
| | | |
| * | | Merge pull request #240 from pwendell/masterPatrick Wendell2013-12-071-4/+4
| |\ \ \ | | | | | | | | | | | | | | | SPARK-917 Improve API links in nav bar
| | * | | SPARK-917 Improve API links in nav barPatrick Wendell2013-12-071-4/+4
| | | | |
| * | | | Correct spellling error in configuration.mdAaron Davidson2013-12-071-1/+1
| |/ / /
| * | | Minor formatting fix in config filePatrick Wendell2013-12-061-1/+0
| | | |
| * | | Merge pull request #236 from pwendell/shuffle-docsPatrick Wendell2013-12-061-1/+1
| |\ \ \ | | | | | | | | | | | | | | | Adding disclaimer for shuffle file consolidation
| | * | | Adding disclaimer for shuffle file consolidationPatrick Wendell2013-12-061-1/+1
| | | | |
| * | | | Minor doc fixes and updating READMEPatrick Wendell2013-12-062-2/+4
| |/ / /
| * | | more docsAli Ghodsi2013-12-063-3/+5
| | | |
| * | | Updated documentation about the YARN v2.2 build processAli Ghodsi2013-12-063-1/+13
| | | |
| * | | Merge pull request #228 from pwendell/masterPatrick Wendell2013-12-051-1/+36
| |\ \ \ | | | | | | | | | | | | | | | Document missing configs and set shuffle consolidation to false.
| | * | | Small changes from Matei reviewPatrick Wendell2013-12-041-2/+2
| | | | |
| | * | | Document missing configs and set shuffle consolidation to false.Patrick Wendell2013-12-041-1/+36
| | | | |
| * | | | Typo: applicatonAndrew Ash2013-12-041-2/+2
| |/ / /
* | | | Merge branch 'master' into wip-scala-2.10Prashant Sharma2013-11-272-3/+27
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala core/src/main/scala/org/apache/spark/rdd/MapPartitionsRDD.scala core/src/main/scala/org/apache/spark/rdd/MapPartitionsWithContextRDD.scala core/src/main/scala/org/apache/spark/rdd/RDD.scala python/pyspark/rdd.py
| * | | Update tuning.mdAndrew Ash2013-11-251-1/+2
| | | | | | | | | | | | Clarify when serializer is used based on recent user@ mailing list discussion.
| * | | Merge pull request #101 from colorant/yarn-client-schedulerMatei Zaharia2013-11-251-2/+25
| |\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | For SPARK-527, Support spark-shell when running on YARN sync to trunk and resubmit here In current YARN mode approaching, the application is run in the Application Master as a user program thus the whole spark context is on remote. This approaching won't support application that involve local interaction and need to be run on where it is launched. So In this pull request I have a YarnClientClusterScheduler and backend added. With this scheduler, the user application is launched locally,While the executor will be launched by YARN on remote nodes with a thin AM which only launch the executor and monitor the Driver Actor status, so that when client app is done, it can finish the YARN Application as well. This enables spark-shell to run upon YARN. This also enable other Spark applications to have the spark context to run locally with a master-url "yarn-client". Thus e.g. SparkPi could have the result output locally on console instead of output in the log of the remote machine where AM is running on. Docs also updated to show how to use this yarn-client mode.
| | * | | Add YarnClientClusterScheduler and Backend.Raymond Liu2013-11-221-2/+25
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | With this scheduler, the user application is launched locally, While the executor will be launched by YARN on remote nodes. This enables spark-shell to run upon YARN.
* | | | | Improvements from the review comments and followed Boy Scout Rule.Prashant Sharma2013-11-271-2/+2
| | | | |
* | | | | Documenting the newly added spark properties.Prashant Sharma2013-11-261-1/+22
| | | | |
* | | | | Merge branch 'master' into scala-2.10-wipPrashant Sharma2013-11-252-1/+2
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/rdd/RDD.scala project/SparkBuild.scala
| * | | | Merge pull request #151 from russellcardullo/add-graphite-sinkMatei Zaharia2013-11-241-0/+1
| |\ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Add graphite sink for metrics This adds a metrics sink for graphite. The sink must be configured with the host and port of a graphite node and optionally may be configured with a prefix that will be prepended to all metrics that are sent to graphite.
| | * | | | Add graphite sink for metricsRussell Cardullo2013-11-081-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This adds a metrics sink for graphite. The sink must be configured with the host and port of a graphite node and optionally may be configured with a prefix that will be prepended to all metrics that are sent to graphite.
| * | | | | Fix Kryo Serializer buffer inconsistencyNeal Wiggins2013-11-201-1/+1
| | |/ / / | |/| | | | | | | | The documentation here is inconsistent with the coded default and other documentation.
* | | | | Merge branch 'master' of github.com:apache/incubator-spark into scala-2.10-tempPrashant Sharma2013-11-211-0/+2
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: core/src/main/scala/org/apache/spark/util/collection/PrimitiveVector.scala streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala
| * | | | Impove Spark on Yarn Error handlingtgravescs2013-11-191-0/+2
| | | | |
| * | | | Fixed typos in the CDH4 distributions version codes.RIA-pierre-borckmans2013-11-141-2/+2
| | | | |
generated by cgit v1.2.3 (git 2.39.1) at 2024-07-31 02:58:05 +0000